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ABSTRACT % 

In preparation for the scheduled expiration of the 
Comprehensive Employment and Training Act (CETA) legislation at the 
end of fiscal year 1982, background information was gathered to 
analyze the effects of. CETA training on participants' post-program 
earnings. An analysis was made of information gathered on persons' 
over 24-years-old who entered a CETA program Ijetween January 1975 and 
June 1976 (the most recent group for which appropriate data were 
available) and of a comparison group of low-income persons ^who were 
not in a CETA training program. The findings suggest the following 
conclusions: (1) Training increased the average future earnings of 
female participants substantially (an average gain of between $800 
and $1,300 annually) • This was probably because CETA training 
programs increased hours worked more than wage rates and because 
female participants had less past employment experience than male 
participants; (2) Training did not seem to affect the average future 
earnings of male participants: This was probably because men had 
previously been employed more than women and there was little effect 
on their wage rates; and (3) Both male and female participants with 
the least past employment experience had the largest earning gains 
after training. It was suggested that future job-training legislation 
consider different means for addressing the employment problems of 
persons with little previous employment experience and of persons 
with previous employment experience but chronically low earnings* 
(KC) 
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SUMMARY 



The Comprehensive Employment and Training Act (CETA), which 
authorizes most job training, programs for low-income persons, is 
scheduled to expire at the end of fiscal year 1982. Several pro- 
posals for new legislation are now before the Congress.-^ Two 
important issues in the design a)id operation of job 'training pro- 
grams are: whom to serve^and what services to provide. To provide 
background information on these issues, this paper analyzes the 
effects of CETA training on participants' post-program earnings. 



CETA TRAINING PROGRAMS 

The federal government will spend about $1.7 billion in 
fiscal year 1982 to support CETA comprehensive job-training 
• programs through Title II-B,C. These programs are administered by 
state and local -governments and provide a variety of services 
including classroom training, on-the-job training, work 
experience, --and job search and placement assistance. In fiscal 
year 1980 (the 'latest year for- which 'complete data were 
available), approximately three-quarters of a million low-income 
.persons were served by these training programs. 

Almost half, of the 1980 participants in ^ETA comprehensive 
training programs were enrolled in classroom training, which took 
place in institutional settings and was designed primarily to pro-- 
vide specific occupational skills such as typing and keypunching, 
as well as basic educational skills such as' those required for a 
high-school equivalency degree (see Summary Table 1). Slightly 
more than a tenth of the participants were enrolled in on-the-job 
training, which took place in actual job settings and was designed 
primarily to provide specific occupational skills, such as automo- 
bile repair and machine tool operation. The remaining four-tenths 
of the 1980 participants were -enrolled in work-experience 



► 

1. The Administration's proposal, the Job Training Act of 1982— 
S. 2184 — was introduced in the Senate on March 9, 1982. The 
Senate passed the Training for Jobs Act~S. 2036~on July 1, 
1982, and the House Committee on Education and Labor reported 
the Job Training Partnership Act—H.R. 5320~on May 17, 1982. 
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.programs, which provided subsidized jobs that focused primarily on 
establishing basic work habits and attitudes. The typical 
work-experience position is difficult to characterize, however, 
because of variations in the degree of supervision and in the 
provision of supportive services. 

Classroom training, on-the-job training, and work experience 
were generally short-term programs — lasting about 20 weeks, on 
average — and usually prepared participants for r'elati\^ly 
low-wage, entry-level jobs. In 1980, the average cost for each 
participant served was $2,400, ranging from an average of $2,100 
for on-the-job training to $2,700 for classroom training. 

1^ 



SUMMARY TABLE 1. DESCRIPTION OF CETA COMPREHENSIVE TRAINING PRO- 
GRAMS (TITLE II-B,C), FISCAL YEAR 1980 , 





All 
Training 


Classroom 
Training 


On-the-Job 
Training 


Work 1 
Experience 


Number of Partici- 
pants Served^/ 


760,000 


360,000 


100,000 


300,000 , 


Percent of 
Participants Served 


100 


47 


13 


40 


Average Duration 
(in weeks) 


20 


21 


19 


20 


Average Cost per 

Participant 

(in 1980 dollars) ' 


2,400 


,2,7,00 


2,100 


2,200 



SOURCE: Based on Department of Labor data. 



a. Based on the average duration per participant. 
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THE EFFECT OF CETA TRAINING ON POST-PRQGRAM 
EARNINGS OF ADULT PARTICIPANTS 

Analysis of information on persons oyer 24 years old who 
entered a CETA program between January 1975 and June 1976 (the 
most recent group for which appropriate data were available) and a 
comparison group of low-income persons who were not in a CETA 
• training program suggested the following: 

o Training increased the average future earnings of female 
participants substantially — probably because CETA training 
programs increased hours worked more than wage rates and 
female participants had less past* employment experience 
than male participants. 

b Training did not seem to affect the average future earn- 
ings of male participants — probably because men had pre- 
viously been employed more than women and th§re was little 
effect on their wage rates. 

o , In addition, both male and female participants with the 
least past employment experi^ce had the largest earnings 
gains after training. * 

The Effect of Training for Women 

For many years before training, female particii>ants consist- 
ently earned less than female comparison group members (see 
» Summary Figure 1). Immediately after training, however, partici- 
, pants' average earnings jumped above those of their comparison 
group and stayed above fot at least' three years (the longest 
period for which appropriate data were available). 

Detailed analysis of this experience indfcated that CETA 
training increased female participants' average post-prpgram earn- 
ings by between $800 and $1,300 annually, with similar gains for 
the three major types of training (see Summary Table 2). because 
only a small portion of this gain was due to increased wage rates', 
training may not have upgraded job skills substantially. Instead, 
its principal contribution was probably to improve j,ob access and 
perhaps to encourage greater labor force participation. Although 
women seemed to benefit more from training than men, they still 
earned less after training — primarily from receiving lower wage 
rates rather than from working fewer hours. 
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Summary Figure 1 . 

Average Annual Earnings for Female CETA Participants 
and Connparison Group Mennbers fronn 1 964 to 1 978 
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000 



1,000 



1 



J_ 



1975 Participants /^^^ 



Comparison Group 



V 

1976 Participants 



/ 



_L 
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! 



1964 1966 1968 T970 1972 1974 

Year 

SOURCE Estimates from the Contmuous Longitudinal Manpower Survey 



1976 



1978 



The Effect of Training for Men 

For most of the period before training, male participants 
consistently earned about as much as did male comparison group 
members (see Summary Figure 2), In the year before they entered 
a training program, however, male participants experienced 
unusually low average earnings^ Nevertheless, soon after leaving 
the program, their earnings returned to' approximately the level 
attained by the comparison group. 

<» 

Men in each of the three major types of training programs 
experienced this same pattern. The best information available 
indicates that male participants' earnings would have^'increased in 
this way even in the absence of training — that is, training had no 
discernible effect on the average post-program earnings of men 
(see Summary Table 2). 
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Summary Figure 2. 



Average Annual Earnings for Male CETA Participants 
and Connparison Group Members Uom 1 964 to 1 978 
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ISSUES AND OPTIONS FOR FUTURE JOB-TRAINING PROGRAMS 

One important issue is whether there is a necessary federal 
role in providing job-training programs . Currently, the federal 
government provides support for programs administered by state or 
local governments. To the extent that such programs ^might receive 
funding from other sources, there would be no need for federal 
involvement. It seems unlikely, however, that other sources would 
replace reduced federal funding for such programs. 

! 

Given ""a federal role, two important issues arise in the 
^design of such programs: 

o What emplo3nnent problems are facing low-income persons? 

o What types of job-training programs are most effective for 



this group? 




SUMMARY TABLE 2. THE EFFECT OF CETA TRAINING ON AVERAGE ANNUAL 
POST-PROGRM EARNINGS BY SEX ' AND TYPE OF 
TRAINING (In 1980 dollars)^/ 



Type of 

Training For WoraenV For MenV 



All CETA Training 800-1,300 

Classroom training 800-1,400 

On-the-job training 700-1,100 

Work experience 800-1,300 



Insignificant 
Insignificant 
Insignificant 
Insignificant 



SOURCE: Estimates from the Continuous Longitudinal Manpower 
Survey and the March 1976 Current Population Survey 
supplemented by individual Social Security earnings 
records. 

a. For persons over 24 years old and in CETA training programs 
more than seven days. 

b. Results are statistically significant at the 0.01 level. This 
indicates a less than one-in-pne hundred chance that a result 
of thi^ magnitude could have happened randomly. 

c. Specific estimates were. $200 for all men in CETA training pro- 
grams and $300, $300, and -$100 for men in classroom training, 
on-the-job training, and work experience, tespect ively . None 
of these estimates was statistically significant at the 0.05 
level. 



In addition, no matter how federal legislation resolves these 
issues, state or local program operators will continue to make 
decisions about whom to serve and what services to provide. 

Two specific a3pects of bills that are . currently " being 
considered as replacements for the Comprehensive Employment and 
Training Act (CETA) relate to the above issues — the eligibility 
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criteria for determining which adults should participate in train- 
ing programs, and the types of training services that would be 
available* 

What Are the Employment Problems 
Facing Low-Income Persons? 

Low-income persons may experience different types of employ- 
ment problems. Persons who have never worked or who have not, 
worked for a long time may face problems in entering or reentering 
the job market • Persons with chronically low earnings , on the 
other hand, may need to be more stably employed and to increase 
their wage rates. Women are more likely to be members of the 
former group, whereas men are more likely to be members of the 
latter group. 

Currently, CETA eligibility criteria do not distinguish 
between low-income persons with little previous employment exper- 
ience and those with chronically low earnings. Although none of 
the proposals Currently pending before the Congress would e:^plic- 
itly distinguish between thes^ groups,^ both the Administration's 
proposal and the Senate-passed bill would focus training programs 
more^*on' persons in families receiving Aid to Families with Depend- 
ent Children — that is, probably more on women who are more likely* 
to have limited job experience. The House Committee bill,'^on the 
other hand, would essentially continue the current eliglbili'ty ' 
criteria. 

What Types of Training Are Most Effective? 

The types of training that are most effective at addressing 
the employment problems facing low-income persons differ for per- 
sons with li ttle previous emplojrment experience and persons' with 
some previous employment experience but chronically low earnings. 

Persons with Little Job Experience . CETA training programs 
seemed to ^ 'effective for persons with limited previous employ- 
ment experience, as seen in the'greater overall earnings gains for 
women. Whether current training was provided in a clas&room set^ 
ting, on the job, or through subsidized work experience, appeared 
to make little difference in participants' average post-program 
earnings. For all three types of training, the discounted value 
of participants' increased earnings during the next sev^^al years 
approximately equaled the federal costs of training. 
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Since most of the earnings gain from CETA training programs 
was due to an increase in the amount of time worked, more emphasis 
on job placement services and less on training might achieve the 
same results at a lower cost per participant. This would be true, 
however, only if the effect of CETA programs was due primarily to 
placement services rather than training. Otherwise, focusing 
mostly on placement servic.e^ migh^ seriously limit potential 
future earnings growth. 

Previously Employed Persons with Chronically Low Earnings . 
None of the current types of training seemed to help persons with 
more previous employment experience but chronically low earn- 
ings — more often men than women. For this group, there is a 
smaller margin for increasing the amount of time worked; this 
means that greater emphasis must be placed on raising their wage 
rates, which would require more extensive, and thus more costly, 
training. The magnitude of the potential benefits of extensive 
training for this group is uncertain; however, some findings of a 
CETA demonstration project, the Skill Training Improvement 
Program, that provided training for more highly skilled jobs, 
suggest the possibility of positive results. 

Current Legislation . All bills currently being considered 
would change the types of services allowed, although in varying 
degrees. Currently, CETA programs provide 'many services, 
including classroom training, on-the-job training, work 
experience, and job placement assistance. The Administration's 
proposal and the Senate bill would eliminate work experience for 
adults, whereas the House Committee bill would retaia work 
experience. In addition, all bills would allow, but not require, 
itiore extensive training. 
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CHAPTER I. INTRODUCTION 



The Congress and the Administration are considering legisla- 
tion that will determine the future of federal job-training pro- 
grams. These programs were originated in 1962 under the Manpower 
Development and Training Act (MDTA), reformulated in 1973 by the 
Comprehensive Employment and Training Act (CETA), and further 
modified by amendments to CETA in 1978. Because CETA expires at 
the end of fiscal year 1982, new legislation is required if the 
federal government is to fund such programs in the future. 

For this purpose, the Administration proposed the , Job 
Training Act of 1982 — S. 2184, which was introduced in the Senate 
on March 9, 1982. In addition, the House ComraLttee on Education 
and Labpr reported the Job Training Partnership Act — H.R. 5320 — on 
May 17, '1982, and the Senate passed the Training for Jobs Act — S'. 
2036~on July 1 , 1982. ' . 

Among the important issues in the design and operation of any 
job-training program are: 

o Who should be served? 

o What services should be provided? 

o Who should provide these services? and 

o 'How should these services be funded? 

This paper" addresses the first two issues by analyzing the 
effects of training programs — not including public service 
employment — on disadvantaged, low-income adults. Chapter II 
describes the' training programs funded under CETA. Chapter III 
examines the effect of these programs on the post-program earnings 
of adult participants. Chapter IV analyzes issues and options in 
the design of future job-training programs. 




CHAPTER ri. CETA TRAINING 



This chapter describes training programs authorized by the 
Comprehensive Employment and Training Act (CETA) . It examines , 
the program structure, the types of training, and the types of 
participants. « 



PROGRAM STRUCTURE AND FUNDING 

The federal government provides funding for CETA training 
programs, primarily for economically disadvantaged persons. Forty 
percent of total CETA funding is currently provided . through 
comprehensive training programs (Title II-B,C)- The remaining 
funding is provided through three categorical programs — special 
federal responsibilities (Title III), youth programs (Title IV), 
and private sector opportunities (Title VII). ^ 

Although federally funded, most CETA programs are administered 
locally. Local program, operators — referred to as prime sponsors 
— decide whom to serve and what types of training to provide with- 
in- federally established guidelines. Discretion is greatest in 
Title II-B,C comprehensive training progratns. 



1. CETA programs have been changed many times since they were 
enacted in December 1973. The original aet included: Title 
I comprehensive manpower services. Title II public employment. 
Title III special federal responsibilities, and Title IV Job 
Corps. Amendments in December 1974 added Title VI emergency 



III-C and VIII were added. I'd October 1978 , CETA was 
reauthorized to include Title II-B,C comprehensive training 
programs , Title II-D transitional employment opportunities , 
Title III special federal^ responsibilities. Title IV youth 
programs. Title Vf countercyclical public service employment, 
T^tle VII private sector opportunities, and Title VIII Young 
Adult Conservation Corps . In August 1981 , the Omnibus 
Reconciliation Act removed the authorization for Titles II-D, 
VI, and Vlli. 



•jobs. 



In August 1977, 
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In fiscal year 1982, 475 prime sponsors — including 76 cities, 
202 counties, 139 consortia, and 58 other jurisdiction^' — adminis- 
tered CETA programs. 2 Prime sponsors may choose to organize them- 
selves in many different, ways. For instance, they may operate 
programs themselves; contract with outside organizations; or pro- 
vide training programs through smalfler governmental units. 

Spending /for CETA comprehensive training programs kept pace 
with inflatiorFTbetween fiscal years 1975 and 1981 — growing from 
$1.3 billion to .$2.2 billion (see. Table 1). Last year's budget 
actions, however, will cut back 1982 spending^ substantially, to 
approximately $1.7 billion. At the same time, due largely to 
changes in public service employment, total CETA spending grew 
from $2.9 billion in 1975 to a peak of $9.5 biljion in 1978, and 
will fall to about $4.4 billion in 1982. As a result of these 
changes, comprehensive training programs currently represent a 
share of total CETA funding similar to their share in 1975. 

TYPES OF TRAINING AND TYPES OF PARTICIPANTS 

CETA comprehensive training programs provide three main types 
of training — classroom, on-the-job, and work experience — as well 
as allowances for participants while being trained and job-related 
services such as counseling and placement activities.^ These pro- 
grams, which are described in this section, offer basic educa- 
tional training, specific occupational training, general exposure 
tfd work, and job search assistance. < 

Participants in CETA training programs are members of low- 
income families. The median family income for adults (persons 
over 24' years old) entering training in 1980 was $5,000. Of these 
participants, one-third received public assistance during the year 
before training (see Table 2). 



2. Prime sponsors are generally state or local governments with 
populations of 100,000 or more. The number of prime sponsors 
has increased from 403 in 1975 to 475 in 1982. The 
distribution of prime sponsors by type of government has not 
changed substantially, however. 

3. This section focuses on the national picture and may therefore 
not apply to particular prime sponsors. 
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TABLE 1. SPENDING FOR COMPREHENSIVE EMPLOYMENT AND TRAINING ACT 
PROGRAMS, FISCAL YEARS 1975-1982 (In millions of 
dollars) 





1975 


1 0*70 

1978 


1 Qfll 


1 Qff9 

1 70Z 


Comprehensive Train- 
ing Programs^/ 


1,331 


1,992 


2,231 


1,700 


Public Service 
Employment Programs^/ 


838 


5,764 


2,387 


274 


Other Programs^ 


751 


1,777 


3,082 


2,428 » 


Total 


2,920 ' 


.9,533 


7,700 


4,402 



SOURCE: Figures for 1975, 1978, and 1981 represent , actual 
spending, from Depar LmciiL ^ Labor data. Figures for 1982 
are CBO estimates. 



a. Includes Title I/II-B,C. 

b. ' Includes Titles II/II-D and VI. 

c. 'Includes Titles III, IV, VII and VIII. 



r 

In 1980, most participants received classroom training or work 
experience rather than on-the-job training, and the types of 
people receiving different types of training varied somewhat (see 
Table 2).^ For example, on-the-job training participants were 
more likely than other participants to be male and were more 



4. Although the overall CETA program has varied since it^, began, 
the comprehensive training portion, on average, does not seem 
to have changed substantially. The duration of training has 
remained fairly constant. Training costs per participant have 
increased by only up to 2G percent in real terms (between 1976 
and 1980) and the characteristics of participants have 
remairied roughly the «ame. Because of this stability, results 

(Continued) 
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TABLE 1. CHARACTERISTICS OF NEW ADULT PARTICIPANTS IN CETA COM- 
PREHENSI^ TRAINING PROGRAMS (TITLE II-B,C), FISCAL YEAR 
198()f^/ ^ 



Charac- 
teristics 


All 
Training 


Classroom 
Training 


On-the- 
Job 
Training 


Work 
Experience 

1 


Percent Male 


"43.7 


38.6 


62.1 


43.6 


Percent Minority^/ 


48.7 


50.5 


38.5 


41.3 


Percent with Less Than 
12 Years of Education 


36.6 


35.1 


35.5 


41.0 


Percent Over 
44 Years Old 


15.3 


12.5 


13.1 


23.2 


Average Percent 
of Time in the 
Labor Force '^1 


68 


66 


74 


69 


Percent in Families 
Receiving Public 
Assistance '^1 


32.7 


35.9 


23.1 


31.6 


Median Family Income '^l 
(in 1980 dollars) 


5,000 


4,900 


5,700 


4,900 



SOURCE: Continuous Longitudinal Manpower Survey* 



a* Includes persons over 24 years of age. 

b. Includes all non-white persons and Hispanics. 

c. During the year before entering a CETA program. 



4» (Continued) 

of ~ the analysis of program effectiveness based on data for 
persons who entered a CETA program between January 1975 and 
June, 1976 are probably indicative of the relative 
effectiveness of current programs. 



likely, on average, to have spent more time in the labor force 
during the year before training began. The occupations for which 
training was provided also varied: for example, in 1976 — the most 
recent year for which these data were available — classroom train- . 
ing participants were more likely to receive clerical training;^'*'' 
than other participants (see Table 3). In spite of these differ- 
ences, however, in 1980 the average duration of all three types of 
training was quite similar and costs, especially for on-the-job 
training and work experience, were also similar (see Table 4). 

Classroom Training 

Classroom training provides occupational skill training and 
basic educational training in an institutional setting. Occupa- 
tional training — provided to about three-quarters of classroom 
training participants in 1980 — provides skills for specific jobs, 
such as clerical workers. Basic educational training — provided 



TABLE 3. DISTRIBUTION OF PARTICIPANTS BY OCCUPATION FOR WHICH 
TRAINING WAS' PROVIDED, FISCAL YEAR 1976f_/ (In percents)' 



Occupation for Which 
Training Was P^vided 


Cl-assroom 
Training 


On-the-Job 
Training 


Work 
Experience 


Clerical 


39 


' 15 


24 


Crafts 


19 


21 


7 . 


Operative (nontransport) 


15 


28 


* 9 


Laborers 


1 


. -8 


16 


Service 


- 17 


11 


26 


Other 


9 ' 


17 


18 


Total 


100 


1 

100 


100 



SOURCE: Westat, Inc.', Continuous Longitudinal Manpower Survey 
Follow-up Report No. 2 (March 1979). • - 



a. includes persons who entered a CETA program duting fiscal year 
1976 and terminated within 18 months. Includes only persons 
who reported an occupation for which training was provided. 
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TABLE 4. DESCRIPTION OF CETA COMPREHENSIVE TRAINING PROGRAMS 
(TITLE II-B,C), FISCAL YEAR 1980 



All Classroom On-the-Job Work 
Training Training Training Experience 



Numbex of Partici- . ^ 

pants ^ervedf/ 757,000 356,000 . 97,000 304,000 

•Percent of Partici- , 
pants Served 100 47 13 -40 

rage Duration 

(in weeks) 20 21 * 19 20 

Average Cost per 
Participant 

(in 1980 dollars) 2,400 2,700 2,100 2,200 



SOURCE: Based on Department of Labor data. 

a.* Based on the' average duration per participant. 

, to about one-quarter of classroom participants in 1980 — focuses on 
general skills,, for example, preparation for high school equival- 
ency degrees or training in English as a second language, rather 
than skills for specific jobs. 

Classroom training is provided in many different settings. 
For example, CETA participants may* enroll with other students in 
courses offered by state and local vocational education institu- 
tions.* Or they may enroll in these institutions for an evening 
clasj? specifically for CETA participants. Or thirdly, they may 
'"participate in a full-time CETA program at, a 'multipurpose skills 
Center. 



Classroom training focuses most heavily on clerical skills, 
probably because these skills can be taught easily in a classroom 
setting. In 1976, 39 percent of occupational classroom training 
Was for clerical jobs; 19 percent was for craft jobs; 15 percent 
was for nontransport operative . jobs; and 17 w percent was for 
service jobs. 
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Forty-seven percent of all training program participants were 
enrolled in classroom training/ at a cost of $2,700 per partici- 
pant, in 1980. On average, these participants received 21 weeks 
of training. Unfortunately, data are not available to describe 
the average number of- hours in training per t>eek or the proportion 
of participants who completed training. 

On-the-Job Training 

» 

0n-th6-job training provides specific occupational skill 
training in actual job settings. CETA subsidizes participating 
employers for part of the wages of untrained persons and generally- 
expects these- persons to continue working for the firm or organi- 
zation that trained them. 

On-the-job training focuses most heavily on operative and 
craft training, probably because these skills may be best learned 
in a workplace setting. In 1976, 28 percent of the participants 
in on-the-job training were trained for operative, jobs; 21 percent 
were trained for craft jobs; 15 percent were trained for clerical 
jobs; and 11 percent were trained for service occupations. ^ 

On-the-job training is the least frequently used type of 
training—representing 13 percent of participants in M980— prob- 
ably because it requires existing jobs. In addition, since pri- 
vate employers generally prefer job-ready workers, more exper- 
ienced persons tend to be selected for these positions. On-the- 
job training provided an average of 19 weeks of training, costing 
$2,100 per participant served in 1980. 

1^ - 

Work Experience 

Work experience differs from classroom training and on-the-job 
training because it focuses more heavily on providing 'subsidized 
employment to instill basic work habits and attitudes rather than 
to teach specific job skills. Work-ekperience jobs are in si- 
tings with varying degrees of supervision, complementary^trainlng, 
and supporti^e;^ services. « V 

Forty percent of all participants iwere enrolled in work-exper- 
ience programs in public or nonprofit organizationj^ in 1980. Work 
experience was most frequently in clerical or service jobs in 
1976—24 percent 'of participants in work experience received 
clerical training and 26 percent training for service^ jobs. 
Work-experience participants received, on average, 20 weeks of^v 
training at a cost of $2,200 per person* in 1980. 
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CHAPTER III. THE EFFECTS OF CETA TRAINING ON THE POST-PROGRAM 
EARNINGS OF ADULT PARTICIPANTS 



This chapter examines the effect of CETA classroom training, 
on-the-job training, and work experience on the post-program 
earnings of adult participants. ^ The first section describes the 
basic methodology used, the second reports the findings obtained, 
and the third briefly interprets these findings. 



ESTIMATING THE EFFECT OF TRAINING 

The effect of training was estimated as the average differ- 
ence between participants' earnings during their first two to 
three yeaif^ after leaving the program, and the best available 
estimates of what they would have earned if training had not been 
provided (see Appendix A). Although these estimates are only 
approximations, they prot^bly provide a reasonable indication of 
the effect of CETA training. 

. Earnings Before and After Training 

Figures 1 through 6 describe the average annual earnings of 
two groups of CETA participants, before and after training, as 
well as the corresponding earnings of a comparison group of sim- 
ilar persons who were not in a CETA program. 

Figure 1 illustrates that, before training, the long-term 
earnings profile of female participants was slightly below ^ that of 
female comparison group members. Immediately after training, how- 
ever, the average earnings of female participants jumped sharply 
above that of the comparison group and remained there for at least 
two to three years (the^ period for ,which data were available). 



1. Youth were not included because earnings in the years after 
j/participating in training — the performance indicator used for 
1 adults — is not always the most appropriate performance indi- 
cator for youth. For a discussion of youth training programs 
see Congressional Budget Office, Improving Youth Employment 
Prospects: Issues And Options (February 1982). 
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Figure 1. 

Average Annual Earnings for Female CETA Participants 
and Comparison Group Members from 1 964 to 1 978 

farntngs 

5,000 I 



4,000 



3.000 



2,000 - 



1,000 - 



1975 Participants /^^-^ 




1976 Participants 



J_ 



J_ 



J_ 



-L 



_L 



1964 



1966 



1968 



1970 1972 
Year 

SOURCE. Estimates from the Continuous Longitudinal Manpower Survey. 



1974 i 1976 



1978 



this pattern was experienced both by women who entered 
training in 1975 and by women ^who entered training in 1976 (the 
two groups for which data were available) In addition, it was 
experienced to a similar degree by" female participants in 
classroom training, on-the-job training, and work experience (see 
Figures 2 and 3) • 

The pattern experienced by male participants was entirely 
different, however (see Figures 4, 5, and 6')'. Their average, 
long-term earnings profile before entering CETA was virtually the 



2. For reasons explained in Appendix A, 1975 participants were\^ 
defined as persons who began CETA training between January and 
August 1975 whereas 1976 participants were defined as those 
who began training between September 1975 and June 1976* 
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Figure 2. 

1975 Female CETA Participants' 
Average -Annual Earnings from 
1 964 to 1 978 



Figure 3, " ' 

1976. Female CE-^ Participants' 
AVfege Annual Earnings from 
1964" to 1978 
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SOURCE Estimates from the Continuous 
Longitudinal Manpower Survey. 



SOLlRCE. Estimates from the Continuous 
Longttudinal Manpower Survey. 



same as that of male comparison group members. But the year 
before entering the program, male participants experienced a sharp 
drop in earnings • Nevertheless, soon after leaving the program, 
their earnings had returned approximately to the same level as 
that of* the comparison group. The best available data indicate 
that the earnings decline .experienced by male participant's (and to 
a lesser extent also by female participants) was temporary and 
would have disappeared rapidly, even in the absence of training 
(see Appendix B\. For reasons explained in Appendix B, this 
"pre-program dip" was probably a statistical artifact produced by 
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Figure 4. 

Average Annual Earnings for Male CETA Participants 
and Comparison Group Mennbers from 1 964 to 1 978 
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the 'fact that eligibility 'for CETA training programs is based on 
short-term rather than long-terra individual earnings experience. 

The Analysis 

The analysis was conducted as follows. First, what each 
participant in t^e sample would have earned if training had not 
been provided was predicted from his or her past earnings trend. 
Figure 7 illustrates this process for a participant whose earnings 
increased sharply after CETA training. ^ 

Next, the difference between each participant's actual and 
predicted earnings was computed for up to three years after 
training (see A, B, and C in Figure 7). This difference—referred 
to hereafter as the deviation from trend — was averaged for all 
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Figure 5. . 

1975 Male CETA Participants' 
Average Annual Earnings from 
1964 to 1978 



Figure 6, 

1976 Male CETA Participants' 
Average Annual Earnings from 
1964 to 1978 , 
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years after training tot each group' of participants, providing a 
rough indication of the effect of training. 

The next step was ,to account for changes in participants' 
earnings that resulted ' if rom fluctuating economic conditions. 
These changes were estimated by observing corresponding deviations 
from the earnings trends Of comparison group members. The average 
deviation from trend for the comparison group was then subtracted 
from the average for participants to refine the initial estimate 
of the effect of training. Because each person's deviation was 
measured from his or her own past trend, it was not necessary for 
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Figure 7. 

Earnings After Training Relative to the Past Long-Ternn Earnings Trend 
of a CETA Participant Who Experienced a Post-Program Earnings Gain 
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the trends of participants and comparison group members to be the 
same, although Figures 1 and 4 indicate that they were quite 
sim^Iar^ on average. 

The principal strength of the preceding approach is the 
ability of past earnings trends to account for individual 
differences in factors that affect future earnings. Past ^trends 
reflect measurable factors that affect earnings, such as age and 
education, plus factors that cannot be measureli directly, such as 
motivation. The approach is, however, only" as strong as the 
relationship between past and future earnings. 

Three further refinements were' made. First, adjustments were 
made to account for the unusually low average earnings experienced 
by participants (especially men) in the year before they entered 
training. Second, all results were expressed in 1980 dollars to 
account for inflation. And third, adjustments were made to 
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account directly for individual differences In personal character- 
istics such as age, education, marital status, and family composi- 
tion. Jo the extent that these characteristics predict J^^y 
future deviations from past earnings trends, it was necessary^ 
control for them explicitly- Doing so had a relatively small 
effect on the .final results, however* 

TRe Data > 

^ The analysis was based on data for CETA participants who were 
over 24 years old, who entered, classroom training, on-the-job 
training, or, work experience between January 1975 and June 1976, 
and who stayed in the program for more than seven days.-^ These 
data were obtained for a sample of 1,615 female participants and 
1,608 male participants from the Continuous Longitudinal Manpower 
Survey conducted by Westat, Inc., and the U.S. Bureau of the Cen- 
sus for the Employment and Training Administration of the U.S. 
Department of Labor/ This large-scale national follow-up survey 
of CETA participants provides detailed information about the 
employment experience of participants before and after training, 
plus data on their personal characteristics In addition, annual. 



3. '' Persons over 24 years old were chosen in order to focus on 

adults with meaningful past earnings experience. Participants 
in public service employment were excluded to focus directly 
on CETA's comprehensive training title. Persons entering 
between January 1975 and June M76 were ghosen bedause they 
were the only groups for whom appropriate data were avail- 
able. And persons staying in the program for more th3h seven 
days were selected to ensure a minimum exposure to training 
-and to be consistent with the criterion' used by other 
researchers. Changing this last criterion to' 50 days did not 
alter the results, however. 

4. For a description' of the Continuous Longitudinal Manpower 
Survey see, Westat, Inc., Impact on 1977 ' Earnings of New FY 
1976 CETA Enrollees in Selected Program Activities , Employment 
and Training Administration, U.S. Department of Labor (1980). 

5. This information was obtained from CETA application forms plus 
surveys administered to participants when they entered CETA 
training programs and approximately 6, 18, and 3.6 months 
later. 
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earnings data for many years before training and up to three years 
after training 'were obtained from the Social Security records' of 
each participant and included as part of the data base.^ 

^Data for the comparison group of 21,096 women and 9,572 men 
were obtained from the March 1976 Current Population Survey 
supplemented by individual Social Security earnings records* Only 
persons who were between 25 and 60 years old, who earned less than 
the Social Security maximum for every year from 1970 through 1975, 
and who were members of families with 1975 incomes less than 
$30,000 were included. in the analysis*^ 



OVERALL FINDINGS 

Because CETA trafning affected men and women differently, 
these effects are reported separately* All results are in 1980* 
dollars and are rounded to the nearest $100. In brief: 

For Women; 

o CETA increased average post-program earnings by $800 to 
$1,300 a year (see Table 5). About four-fifths of this 
increase was due to an increase in the amount of time 
worked and about one-fifth was due to incre^^ed wage 
rates. , . 

o In addition: the effects of classroom training, on-the- 
job training, and work experience were roughly the same; 
participants with the ' least previous labot^ market exper- 
ience increased their earnings^ the most; the effect" of 
training did not diminish during the first two to three 
years after training; and the effect of training appeared 



6» For a discussion of, this process see Westat, Inc. (1980). 

7. The maximum earnings covered by Social Sectg^ity and thus 
reported by Social Security records were $7,800, $7,800, 
$9,000, $10,800, $13,200, and $14,100 from 1970 through 1975,. 

, * respectively. Persons in families with incomes greater than 
$30,000 were eliminated to be cpnsistent with the analysis by 
Westat, Inc., who supervised development of the data base. 
See Westat, Inc., Continuous Longitudinal Manpower Survey! The 
Impact of CETA on Participant Earnings, Working Paper 2 , 
U.S. Department of Labor (June 1980), p. 2-6. 
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TABLE 5. THE EFFECT OF CETA TRAINING ON AVERAGE ANNUAL POST- 
PROGRAM EARNINGS BY SEX AND TYPE OF TRAINING (In 1980 
dollars)^/ 



Type of 
Training 


Women^/ 


Men 


All CETA Training 


800 - l,300f^/ 


2oo£/ 


Classroom training 
On-the-job training 
Work experience -» 


^800 - 1,400^/ 
700 - 1,100C/ 
800 - 1,300*^/ 


300^/ 
300'3"/ 
-100^/ 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey and the March 1976 Current Population 
Survey supplemented by individual Social Security earn- 
ings records. 

a. For persons over 24 years old and in CETA training more than 
seven days. 

b. The upper bound of each range includes earnings gains due to 
increased labor force participation, increased ability to find 
and hold a joi, increased hours worked per week employed, and 
increased wage rates. The lower bound excludes earnings gains 
due to increased labor force participation and ^increased hours 
worked per week employed. 

c. Significant at the 0.01 level. 

d. Not significant at the 0.05 level. 



to increase with the length of training (although this 
last finding may simply reflect the fact that women with 
the greatest potential were least likely to drop out of 
the program) . 

For Men: 

o CETA training did not appear to affect average post- 
program earnings, although for two subgroups there was 
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some evidence of an effect. This evidence was subject to 
qualifications,, however. 

The Effect of CETA Training for Women 

Average Post-Program Earnings Gains . Women in classroom 
training increased their average post-program earnings by about 
$1,400 a year, women in work experience programs increased their 
average post-program earnings by about $1,300 a year, and women in 
on-the-job , training increased their average post-program earnings 
by about $1,100 a year. These large gains were significant 
according to accepted statistical standards^ and were consistent 
with the findings of past studies based on similar data.^ They 
represent the upper limit of the range of results for women in 
Table 5. 

The small differences in the results for the different types 
of tr^aining were not statistically significant and thus do not 
necessarily indicate true differences in effectiveness. There- 
fore, it appears that aH three types of training had roughly the 
same effect. 

This finding is contrary to that of several other researchers 
who concluded that on-the-job training was most effective. But 
for reasons discussed in Appendix E, the statistical model used by 
these researchers did not fully compensate for the fact that 
on-the-job training participants earned substantially more* than 
the other participants did before they entered training. 

Changes in the Components of Earnings . The average earnings 
gain experienced by female participants was due 'to changes in: 



8. Statistical significance indicates that a finding is unlikely 
to reflect a chance sampling error. All statements in the 
text about statistical significance are based on the 
conventional 0.05 level, unless otherwise indicated. 

9. See Orley Ashenfelter, "Estimating the Eff,ect of Training 
Programs on, Earnings The Review of Economics and Statistics , 
vol. LX, no. 1 (February 1978), pp. 47-57. Also see Nicholas 
M. Klefer^ "The Economic Benefits from Four Government 
Training Programs , " in F .E . Bloch , ed . , Research in Labor 
Economics; Evaluating Manpowers Training Programs , (JAI Press, 
1979), pp. 159-86. 
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o their labor force participation (the amount of time they 
were available for emplo3rment) ; 

o their ability to find and hold a job , (measured by the 
amount of time they were employed as a proportion of the 
amount of time they were available for employment) ; 

o the number of hours they worked per week employed 
(reflecting their mix of part-time, full-time, and 
overtime employment); and 

o their average hourly wage rate. ^ 

To further refine estimates "of the effect of training for 
female participants, it was necessary to examine the role played 
by each of these basic components of earnings. 

Table 6 describes each component, during the year before an^ 
the first year after CETA training.' According to calculations 
based on this information (see Appendix F) , 21 percent of the 
average earnings gain for female CETA participants was due to^ 
increased labor force participation; 39 percent was due to an 
increased ability to find and hold a job; and 18 percent was due 
\o an increase in hours woi*:ed per week employed. Thus a total of 
percent was due to factors relating to- an increase in the 
:aitfoiiit of time employed. The remaining 22 percent was due to 
increased wage rates. 

To 'interpret these results for women, one must examine the 
role of each earnings component. Fbr example, consider labor 
force participation. Labor force participation's contribution to 
post-program earnings gains represents an increase beyond that 
predicted by participants* past experience, by the experience of 
comparison group members, and by individual personal characteris- 
tics. To fehe extent that training produced this unusually large 
increase (for example, by instilling self-confidence in women 
entering the labor force for the first time or- reentering after a 
long absence), earnings gains due to increased labor force 
participatioa should be attributed to training. But to the extent 
that this 'increase r'epresents a self-selection process whereby 
women already predisposed to entering th*e labor market were more 



10. These percentages are only approximations and are Subject to 
qualifications discussed in Appendix F. 
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TABLE 6. LABOR FORCE PARTICIPATION, EMPLOYMENT, HOURS WORKED, AND 
WAGE RATES BEFORE AND AFTER CETA TRAINING ^/ 



Women Meq 



1 

m 


-Year 
Before 
Training 


Yeac 
After 
Training 


Year 
Before 
Training 


Year 
After 
Training 


Average Number of Weeks 
in the Labor Force 


35 


* 41 


43 


46 


Average Time Employed as 

a Proportion of Average Time 

in the Labor Force 


0.47 


0.62 


9 .'57 


0.63 


Average Number of 
HouTs Worked per 
Week Employed 


33 


38 


35 


40 


Average Hourly Wage Rate 
for- Time Employed 
(in 1980 dollars) 


3.81 


4.49 


5.41 


5.93 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey. 

a. For persons over 24 years old and in CETA training more than 
seven days. 



likely to participate in CETA, its contribution to future earnings 
gains should not be attributed to training. 

Next, ^consider participants' ability to find and hold a job. 
This component ' s contribution to post-program earnings gains 
represents an unusually large improvement in participants ' 'success 
in the job market.- Such an Improvement was unlikely without 
training. 

The third component ,of earnings, hours worked per week 
employed, reflects participants' mix of part-time, full-time, and 
overtime emplo3rment. To some extent, an increase in this factor^ 
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could have been produced by female participants' decisions to 
shift from part-time to f ull-'time-^'^'ployment . But much of this 
shift may have required assistance in preparation for and fj.nding 
full-time employment. f 

The fourth component of earnings was wage rates, which 
largely reflects . individual skill levels. Its contribution to 
earnings gains- represents an increase in wage rates beyond that 
normally expected. Such an increase was unlikely 'to occur without* 
the assistance of training. ^1 

More Conservative Estimates of the Effect of Training . The 
preceding discussion indicates that even though the estimates of 
post-program earnings gains discussed above accounted for tfie past 
exp^eflence of participants, the past and post-program experience 
of comparison group members, and differences in 'personal characr 
teristics, they may overstate the effect of* CETA training for 
female participants. More conservative estimates were obtaiijed by 
eliminating the portion (roughly two-fifths) due to shifts in *th$ 
two components that probably could have been most easily changed 
by female participants, even "without special assistance-tiabpr 
force participation and hours -worked per week employe^./"* .Thfe^ 
estimates, which may understate thfe effect of training^- Indiclite 
that all three types of CETA training increased the average ppat- 
program ' earnings of female participants substatitially^* (Isee , t\\%' 
lower bound of the ranges in Table 5). ' >t ' ^ * ,/ * - . 

Duration of the Effect of Training . A comparison ,of earnijigs. 
gains for each of the first three years after female participants 
had left training yielded no sign of decay over time.. In ^addi-. 
tl,on, past studies based on similar data indica^-ed that the effect 
of training fot women p'ersisted for at leastt' three tt) 'five years 
.(the maximum period for which' flata were available).^? / 

The Effect of! CETA Training for Mep - 

None of the three types of CETA .training /appeared to affect 
the average post-program future earnings of male participants (8€?e 
Ta^le 5). After experiencing a sharp earn^ings^^frop in/the year 



11. ^Some of the increase in wage rates may, however, ^^lav^ , be^p 

due to shifts from pafT=r±me to full-time employment, some 
portion of which might have occurred without' training. 

12. See Ashenfelier, op. cit., and Kiefer, .op. cit. • . ^■ 



before training, m^4;e participants returned , to their past trend 
after they left the program. According tp the best information 
available, this would have occurred without "training (see Appendix 

a 

This finding does not mean that CETA training had no effect 
on the future earnings of male participants. A small effect could 
have been missed by the analysis because of the ^ range of 
uncertainty: (several hundred dollars) produced by inevitable 
limitations in the data. Nevertheless, the findings suggest, thkt 
training probably did not have a large effect for male 
participants. 

Secondly, the finding does not imply that no training 
programs were effective for any groups of male participants. Some 
local programs might have been quite effective, but there was no 
way to identify these programs given the available data. In addi- 
tion, some of the evidence below, although subject to qualifica- 
tions, suggests that spme subgroups of male participants may have 
increased their fut^ure earnings because of CETA training. ^ 

V 

COMPARING RESULTS FOR MEN AND WOMEN 
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Women probably benefited most from CETA because they had the 
greatest margin for increased employment — the component of 
earnings that appeared to be most responsive to training. But 
even so, they did not earn as much on average as male participants 
did after they left the program. 

Why Women Benefited More Than Men Did 

Differences in past labor market experience rather than dif- 
ferences in' personal characteristj.cs probably explain why women 
•benefited more than men did from CETA training. For example, the 
average ages, the average education, and the percentages of 
minority ^ group members were roughly* the same for male and female 
participants (see Table 7). ^ But their past latior market exper- 
iences were quite different (see Tables 6 and 8). 

Women were in the labor force for 35 weeks, on average, during 
the year before they began CETA training, and were employed for 47 
percent of the time they were in the labor fdrce (see Table 6). 
Men, on the other hand, were in the labor force for 43 weeks, on 
average, during the year before they began training and were 
employed for 57 percent of this time. 
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TABLE 7*, CETA' PARTiCIPANT AGE, EDUCATION, AND MINORITY STATUS^/ 



Average 

Years of 

Schooling 
Average Age ' Completed Percent 
/ At Entry " At Entry Minority^ 



Male Participants 


^ 3 -4 


11.0 


42 


In classroom training 
'^n on-the-job training 
In work e'xperience 


33 
33 
36 


11.1 
11.3 
10.8 


52 
32 
38 


Female Participants 


^ 35 ' 


11.1 


47 


In classroom training 
In on-the-jo^ training 
In work e^tperience 


34 
35 
37 


10.9 
11.4 
11.5 


54 

36 

r 


SOURCE: Estimates were 
Manpower Sjirvey 


derived from the 
• 


Continuous Longitudinal 


a>. For persons over 24 


years old' and in 


CETA 


training for more 



than seven days* 
b. Minority participants Include non-whites and Hispanics. 



Furthermore, a much greater proportion of female participants 
had no , employment ^experience before they entered training (see 
Table 8). Twelve percent of the female participants were never 
employed during the four- to five-year period before they entered 
training, whereas only 4 percent of the male participants were in 
this category. 

"t 

Table 8 indicates that regardles oi sex, earnings gains after 
training were much larger for persons with no previous employment 
experience thanl they were for persons. v0^h ^ome previous exper- 
ience • Female participants wifh no pdit employment had a $2,500 
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TABLE 8. EARNINGS GAINS BY SEX AND PREVIOUS EMPLOYMENT ' EXPER- 
IENCE^/ 

- ft, ' 



Group 


Number of 
Participants 


Percent 
of Sample 
by Sex 


Average 
Earnings Gain 


Female Participants 


1^615 ^ 


100 


1,300^/ 


Not previously employed V 


- 190 ' 


12 


2,500^/ 


Previously employed 


1,425 


88 


1,200£/ 


Male Participants 


i;608 


100 


200£/ 


Not previously employed^/ 


66 


4 


4,500^/ 


Previously employed 


1,542 


96 


ioo£/ 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Syrvey and the March 1976 Current Population 
Survey supplemented by individual Social Security earn- 
ings records. 



a. For participants over 24 years old and in CETA training pro- 
grams for more than seven days. 

b. Persons with no earnings reported to the Social Security 
Administration between 1970 and entry into a CETA program. 

c. Significant at the 0.01 level. 

d. Not significant at the 0^*05 level. 
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average earnings gain, while those with some previous anployment* 
had a $1,Z00 gain. Corresponding results for men were $4,500 and 
$100.1^ 

Given the fact that women had far less previous employment 
experience than men, and that post-program earnings gains declined 
markedly as previous' employment experience increased, it is likely, 
that differences in previous experience account for a large 
portion of the difference in the effectiveness of CETA training 
for men and women. 

The Earnings Gap Between Men and Women 

The large earnings gain experienced by female participants 
was not big enough to eliminate the initial gap between them and 
their male counterparts^. On average, women earned $4,300 and men 
earned $6,800 in the year after leaving CETA training programs. 
The remaining gap primarily reflected the Higher wage rates 
received by men, and to a lesser extent their greater Ubor force 
participation. In terms of finding and holding a job and the 
number of hours worked per week employed, the' post-program 
experiences of female and male participants were essentially the 
same • 



VARIATIONS IN RESULTS BY LENGTH OF ' 
TRAINIt^G AND MINORITY STATUS OF PARTICIPANTS 

« 

LoTiger training was associated with larger Earnings gains for 
women, but in general there was no effect for men, on average, 
regardless of the length of training. In addition, there was no 
consistent difference between the effects of training for minority 
and non-minority participants. 

Variations by Length of Training 

Longer classroom training, on-the-job training, and. work 
experience were associated with larger earnings gains for female 
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13. The observed earning's gain for men who were previously not 
employed, and to a lesser ex'ent for women who were previously 
not employed, may reflect employment shifts from jobs not 
covered by Social Security to jobs that were covered. Thus 
they must be interpreted with caution. This was probably much 
less of a problem for persons with some past emplojrment. 



g6-112 0-82-7 



/ 



participants (see Jable 9). The average gain for women with 100 
days of training (the average length of training was 150 days) was 
about $1,200 a year, whereas the corresponding gain for women with 
200 days of training" was $1,500. In addition, the relationship 
between the number of days of training and future earnings gains 
for women was roughly constant over the range of program lengths 
examined (from about 10 to 250 days). N 

The preceding findings should be interpreted with caution, 
however, in light of three important data limitations. First, it 
was not possible to measure program intensity in terms of the 



TABLE 9. EARNINGS GAINS BY SEX, TYPE OF TRAINING, AND LENGTH OF 
TRAINING (In 1980 dollars)^/ • ' 



Women^/ 



Men^/ 



Training 


100 'Days 


200 Days 


100 Days 


200 Days 


All CETA Training , 


1,200 


1^500 


200 


100 


Classroom training 


1,200 


1,600 


200 


500 


On-the-job training 


1,000 


1,700 


400 


-400^/ 


Work experience 


1,200 


1,500 


0 


-400"^/ 



SOURCE,: Estimates were derived from the Continuous Longitudinal 
Manpower Survey and the March 1976 Current Population 
Survey supplemented^ by individual Social Security earn- 
ings records. 

a. For persons over 24 years old and in CETA training more than 
seven days. ^ - « . 

b. All results for women were significant at the 0.01 level. 

C» All results for men were not significant at the 0.05 level. 

d. This result does not necessarily represent a negative effect 
^ b'ecause it is not statistically significant and thus cannot be 
distinguished from a finding of no effect. 
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number of hours of training per day. Second, it was not possible 
to distinguish on a consistent basis between persons who had com- 
pleted training and persons who 'had dropped out prematurely.- 
Third, it' was not ^possible to separate the actual effect of 
lengthening training' from selection effects due to women with the 
greatest potential staying in training the longest. 

Variations by Minority Status *^ 

There was no consistent pattern in the observed differences 
in the effect training for minority and non-minority persons 
(see Table 10).^^ Both minority and non-minority female partici- 
pants experienced large future earnings gains, with some evidence 
of a smaller gain for minority women. But in five out of six. 
cases,, there was no significant effect iot minority or non-minor- 
ity male participants. The one exception ho this rule — on-the-job 
training for minority males — produced the largest earnings gain 
for any group examined in Table 10. Because this result was based 
on the experience of only 130 participants (representing 4 percent 
of the sample)' and because it was inconsistent with virtually all 
other findings in this paper, it should be interpreted with 
caution. Furthermore, because this finding produced a significant 
^600 overall average earnings gain for minority men when the 
results for both classroom -training and work experience indicated 
no significant effect for this group, the overall average result 
for minority men should arlso be interpreted with caution. 



INTERPRETATION OF THE FINDINGS 

Chapter II indicated that the typical CETA training program 
provided relatively short-term training for entry-level jobs. 
This chapter has shown that the main effect on' earnings of this 
training (when it has been effective) was to increase the amount 
of time that participants worked. ^ Only a small effect on wage 
rates was observed and thus it appears that there was probably 
little effect on job skills. 



14. Non-minority participants included all persons who were white 
and not Hispanic. Minority participants included everyone 
else. . - , 

15. Some effect on skills could have produced the observed 
increase in hours worked, however* 
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TABLE 10. EARNINGS GAINS BY SEX, MINORITY STATUS, AND TYPE OF 
TRAINING (In 1980 dollars)^/ 





Women^/ 


Men 


Minority Parti'cipancsW 
In classroom training 
In on-Che-job trraining 
In work experience 


"l',000 
1,100 

800^/ 

900 


600^/ 
' 3006/ 
1,500"^/ 

300^/ 


Non-Minority Participants^/ 
In classroom training 
In on-the-job training 
In work experience 


1,300 
1,300 
1,200 
1,400 


-1006/ 
3006/ 
-2006/ 
-3006/ 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey and the March 1976 Current Population Sur- 
vey supplemented ]>y individual Social Security earnings 
records.. 



a. For persons over 24 years old and in CETA training more than 
seven days. , ^ 

b. Non-minority participants include all persons who were white 
and not Hispanic. Minority participants include all other 
groups. 

c. All res-ults for women, except for on-the-job training for 
minority participants, were significant at the 0.01 level. 

d. Significant at the 0.05 level. 

4 

e. Not significant at the 0.05 level. Negative results do not 
necessarily represent a negative effect, however,* because 
these results are not statistically significant and thus can- 
not^be distinguished from a finding of no effect. 

f. Significant at the 0.01 level. 
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These findings are consistent with* the result that CETA 
training worked best for gersons with little or no past employment 
experience— xhe group with the greatest margin for responding to 
training's principal effect. 

Similarly, thes4 findings help to explain why female CETA 
participants (who have little past employment experience, on aver- 
age). appeared to benefit more from training than male participants 
(with more past employment experience, but chronic low earnings) 
did. . ' 

Furthermore, the preceding findings help to explain why no 
consistent 'differences were observed in the effectiveness of the 
three major types of CETA training— classroom training, on-the-job 
training, and work experience. In theory, classroom training and 
on-the-job training emphasize the development of specific job 
skills whereas work experience emphasizes the development of gen- 
eral work habits. Thus the first two types- of training might- be 
expected to have a larger long-term impact on earnings. But in 
practice, none of the types of training appeared to improve skills 
substantially, perhaps because more extensive training would have 
been necessary. Their major effect was to increase the amount of 
, time worked by participants, a task for which all three approaches 
might be equally well suited. 
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CHAPTER IV. 



ISSUES ANI> OPirONS FOR FUTURE JOB- 
TRAINING PROGRAMS 



This chapter examines several important issues in the design 
of future federal traini-ng programs: 



o What are the employment problems facing low-income per- 
sons? 

o Can job-training programs help this group? . 

- o Is there a necessary federal role in providing job-train- 
ing programs? and . , - 

o What training .services would be most effective? 

Two specific aspects of bills that are currently being con- 
sidered -as replacements for the Comprehensive Employment and 
Training Act (CETA) relate to ^he above questions—the eligibility 
criteria for determining which adults should participate in train- 
ing programs, and t}ie types of training services that ;would be 
available,! In atldition, no matter how federal legislation 
resolves these issues, state or local program operators will con- 
tinue to address the problems of whom to serve and what Services 
to provide. 

• 

WHAT ARE THE EMPLOYMENT PROBLEMS 
FACING LOW-INCOME PERSONS? 

Low-income .persons do not all experience the same employment 
problems. Persons who have never worked or who have not worked 
for a -long time may face m,ajor difficulty in entering or reenter- 
ing the job mafket. ' Persons who have been employed but with 



1. 



As mentioned previously, three main bills are currently pro- 
posed to replace CETA: the Administration's proposed Job 
Training Act of 1982 (S. 2184), the Training for Jobs Act (S. 
2036) passed by the Senate, and the Job Training Partnership 
Act (H.R. 5320) reported by the House Committee on Education 
and Labor. 
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chronically low earnings, on the other hand, may need to be more 
stably employed and to increase their wage rates. Women are more 
likely to be members of the former group, ^whereas men are more 
likely to be members of the latter group. 

Currently, CETA training programs do not explicitly distin- 
guish between low-income persons with little, or no previous job 
experience and those with chronically low^earnings. Low-income 
persons are eligible to participate in CETA training programs 
under Title II-B if they are out of work, underemployed, in 
school, or receiving public assistance at the time they apply for 
training.^ 

Persons eligible to receive training do not necessarily have 
the same characteristics as those who enter training ptograms. In 
fiscal year 1980,. at least 16 million persons were eligible . for 
CETA training programs while only about 760,000 persons obtained 
training. 3 Approximately two-thirds of the eligible population 
were women and about three-quarters were in families receiving 
wfelfare payments.^ Only one-third of . the admits who^ became 
participants were members of families receiving welfare, however. 
Persons receiving welfare, often women, are more likely to be 



2. The current income criteria require that a person be a member 
of a family, receiving public assistance or a member of a 
family whose income — excluding such sources as public assist- 
ance and unemplo3rraent insurance — during the previous six 

' months on an annualized basis was suph that (1) the family was 
eligible for public assistance or (2) the family , income was 
less than or equal to 70 percent of the Bureau of Labor 
Statistics Lower Living Standard^ or (3) the family income was 
less than or equal to the Office of Management and Budget 
poverty guidelines; 

3. This estimate of th^ eligible population^ based on the !4arch 
1978 Current Population Suryey (CPS) ftodified to represent ' 
fiscal year 1980, represents persons who would have been 

. eligible during 1980. Since eligibility depends on the 
person's employment status, these data underestimate somewhat 
the current eligible population because the unemployment rate 
represented in the data was 6.8 percent, compared to an actual 
rate of 9.5 percent in June 1982. 

4. These data on the eligible population and participants include 
persons under the age of 25. 
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members of the group with little previous job experience than are 
other low-income persons. 

Two of the three proposals currently pending before the 
Congress would alter existing CETA eligibility criteria for 
adults. The Administration's proposal would serve two main 

.groups: low-income youth and adults who Were in families receiving 
Aid to Families with Dependent Children (AFDC) . For adults, this 
change would focus training more' heavily on women and persons with 
limited previous employment . The Senate bill would continue 
generally to serve low-income persons but would reguire that at 
least 50 percent of the funds be used for youth and that both 
persons receiving AFDC and high school dropouts be served in pro- 
portion to the size of the groups in the area's eligible popula- 
tion. This proposal would ^ increase the number of welfare recip- 
ients in training programs and thus the proportion of participants 
with little , previous job experience; however, the, increase would 
not be as large under the Administration's proposal. The House 
Committee bill, on the other hand, would have separate training 

'programs for youth and adults. For adults, the current eligibil- 
ity criteria would essentially continue. 

CAN JOB-TRAINING PROGRAMS HELP LOW- INCOP. PERSONS? - 

Evidence reported in Chapter III suggests that CETA training 
benefited principally persons who had little previous job exper- 
ience, as reflected by the fact that women, on average, benefited 
more than men. Their gains resulted from increased employment 
more than from increased wage rates, and may thus indicate only a 
small increase in skills. 

Further evidence of the 'responsiveness to training of persons 
who had not previously been employed .much is provided by the 
National Supported Work Demonstration Project. This project pro- 
vided a tightly supervised, supportive work environment for per- 
sons experiencing long-t^ labor market problems. The group that 
benefited most from this program, in terms of lateif earnings, was 
women who had - been receiving welfare for roughly three ,or more 
years and who had previous worked relatively little.-' 



5. This demons^tration project tested the effects of supported 
work on persons with severe employment problems, ^ concentrat- 
ing on four groups — women who had been receiving welfare for 

(Continued) 
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On the other hand, CETA training ' programs do not seem to 
improve the earnings of persons with chronically low earnings 
since, on average, men did not seem to benefit from training. 
Other types of training might improve the earnings of this group, 
however. 



IS THERE A NECESSARY FEDERAL ROLE 
IN PROVIDING JOB-TRAINpjG PROGRAMS? 

* Another important issue is the role of the federal government 
in the funding and operation of training programs. Currently* the 
^ federal government provides support for programs administered by 
state or local governments. To the extent that such programs 
might receive funding from other sources — for example, from state 
or local governments or the private sector — the federal government 
would not necessarily need to be involved. It seems unlikely that 
other sources would replace lost federal funding for such pro- 
grams, however, since they have not done so in the past. In addi- 
tion, there is some ^preliminary evidence * that state and local 
governments are not replacing last year's federal funding reduc- 
tions.^ 

If federal funding for CETA ceased and no alternative funding 
was provided, persons who would have entered CETA training, pro- 
grams probably' would not obtain other training. Persons who/fiad 
been ^raployed relatively little would probably earn less in the 
future than they would have after receiving training. On the 



5. (Continued) 

long periods , ex-addicts, ex-convicts, ^and young school 
dropouts. The project included 10 sites with 3,200 persons 
participating in supported work and 3,400 persons in the 
control group. All participants and control >group members 
were volunteers who were then randomly assigned to the program 
and control groups. * See Manpower Demonstration Research 
Corporation, Summary and Findings of the National Supported 
Work Demonstration (Ballinger Publishing Company, 1980). 

6. See Richard P. Nathan, et al. ''Initial Effects of the Fiscal 
Year 1982 Reductions in Federal Domestic Spending" (Urban 
Institute,- May 1982). 
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other hand> previously employed persons. wiJiJi chronically low earn- 
ings would probably earn about the same in the future as they 
would if training were provided. 

The' extent of federal involvement--ln decision-making about 
program design could also vary. Under the current system, state 
or local governments determine whom to serve and what services to 
provide within fecieral guidelines. Continuing this system could 
provide participants the most effective, services available if 
state or local program operators are more familiar with their 
specific training needs and opportunities than the federal govern- 
ment. On the other hand, program administrator^ may focus more on 
achieving short-terra job placements rather than on the possibility 
of long-term earnings gains. 

WHAT .TRAINING WOULD BE MOST EFFECTIVE? 

The employment needs and the types of training that are most 
effective at addressing these problems differ for persons with 
little previous employment experience and employed persons with 
chronically low earnings. ' , < ' 

« 

Persons with Little Previous Employment Experience 

CETA training programs seemed" to be effective for persons 
with limited work histories; they show greater overall earnings 
gains for women, who are more likely to have little^ or no^ job 
experience than men. This training is fairly short-terra — on 
average about 20 weeks— and focuses primarily on the work habits, 
attitudes, and skills necessary for low-wage, entry-level jobs. 

Whether current training is provided in a classroom setting, 
on-the-job, or through subsidized work experience appeared to make 
little difference in participants' average post-program earnings. 
For all three types of training, the discounted value of 
participants' increased earnings over the next several years 
approximately equaled the federal costs of training. Classroom 
training costs somewhat more than work experience and on-the-job 
training, however. 



7. It is possible, however, that this result might differ for 
more extensive training that focused on higher-l^vel skills. 



52 



Classroom training costs could be reduced by , eliminating" or 
restricting allowances for participants ^ir^ce ^tKes'e payments 
represent approximately one-half of costs. In fact, if all allow- 
ances-were eliminated, classroom training could pay off. more 
quickly than the other types of t;raining> Although eliminating 
allowances for all persons could double, the number of participants 
served for the same total cost, it jnigh^^x^sult in some persons 
being unable to participate for lack of income.^ It is also poss- 
ible that different types of people might 'then receive classrbom 
training, with a different degree of ^effectiveness . Providing 
allowances based on need might alleviate these problems. 

Since moat of the earnings gain from CETA training progrcims 
was due to an increase in the amount of time worked, more emphasis 
on job placement services and less on formal training might 
achieve the same results as current training programs at a lower 
cost per participant. In particular, job placement services could 
be offered through job ireferral assistance or, through "job search 
assiWance,. Job referral assistance involves locating, and devel- 
opingxiob openings ^nd matching job seekers with openings. Job 
search assistance involves teaching people how t*o look for jobs 
and supervising their search. Although lob referral assistaiice 
generally costs less than job search assistance, intensive ^^oup 
search seems to produce high'er placement rates.^ 

On the other hand, if the effect of CETA training programs on 
ea^'rnings is not due primarily, to its assistance in facilitating 
entry or reentry into the labor market, focusing mostly ' on 
placement services might be unsuccessful. It might 'also seriously 
limit potential future earnings growth by reducing the emphasis on 
increasjLQg^^^k|lls . Unfortunately, the data were not available to 
determine whether or not the main .effect of CETA training results 
from its provision of placement services. ,j 

1/ 

^ 

8« Although eliminating allowances would reduce CETA spending, 
federal spending bn other programs could increase if partici- 
pants obtained income assistance from other programs. ^ 

9. Proponents of group job search argue that it is effective 
because it resembles the way in which people generally find 
jobs — through informal contacts and the use of multiple job- 
search methods. See Elise Bruml and John Cheston, "Placement 
Assistance in the ES, WIN and CETA"-(-p^er funded in part from 
U.S. Department of Labor, March 1982).'* 
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All bills currently being considered would change the types 
Of services allowed, although in varying degrees. Currently CETA 
programs provide many services, including classroom training, on- 
the-job training, work experiences^ job placement assistance, and 
allowances ^or participants while being trained. The 
Administration's proposal would eliminate work experience and 
"^lowances for participants. The Senate bill would also eliminate 
work experience and current participant allowances. On the other 
hand, the House Committee bill would retain work experience and, 
for needy persons, allowances. 

" Previously Employed Persons with Chronically Low Earnings 

None of the current types of training seemed" to help persons 
with chronically low earnings — more often, men than women. For 
this group, for whom there is^a smaller margin for increasing the 
amount of time worked, greater reliance must be placed on raising 
wage rates. Obtaining higher-wage jobs requires greater skills, 
which in turn probably requires more extensive, and thus more 
expensive^ training. In other words,, to increase substantially 
the future earnings of recently employed persons with chronically 
low earnings would require concentrating more resources on fewer 
individuals. 

For this group, the magnitude of the potential benefits of 
extensive training is uncertain; however, some results from a CETA 
demonstration praject, the Skill Training Improvement Program, 
that provided training fog^tmaMUiighly skilled job§, suggest that 
positive results might "fe possible. This study of 15 prime 
sponsors indicated' that a greater proportion of these participants 
obtained jobs when leaving the program, and at higher wage rates,' 
than participants in CETA comprehensive programs. The study did 
not, however, examine ^the long-tdrm effects and dftl' not include a 
control group. , ^ 

Bills currently before the Congress would allow, but not 
requirfe, longer training^ y 



10. See Abt Associates, Inc., STIP I; CETA and the Private 
Sector (prepared for U.S. Department of Labor, September 
1979). 
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APPENDIX A. ESTIMATING THE EFFECT OF CETA TRAINING ON PARTICI- 
PANTS' FUTURE EARNINGS 



This appendix expands the discussion in Chapter III of how 
the effect of CETA training programs was estimated. It provides 
an overview of the methodology, a brief description of the data, a 
discussion of the statistical model, and an explanation of the 
estimation procedure. '^Further methodological issues are discussed 
in Appendixes B through b. ' 



OVERVIEW OF THE METHODOLOGY 

The methodology used to estimate the effect of training can 
be described approximately in five basic steps. The » outcome of 
each step is presented in Table A-1. 

Step 1: Estimating Participants' Post-Program Shifts From Their 
Past Earnings .Trends ^ 

A linear trend fit through 1970-1973 annual earnings for each 
CETA participant was used to predict future earnings in the ab- 
sence of traltning (see Figure A-l).l A $1,100 average difference ^ 
(in nominal dollars)' between actual and predicted post-program 
earnings was obtained for female participants and a $100 average 
difference was obtained for male participants. 

Step 2; Accounting for Changing Economic Conditions 

Corresponding shifts from past earnings trends were estimated 
for comparison group members during the post-program period. 
These shifts (roughly $300 for women and $200 for men, in nominal 
dollars) were subtracted from the results of Step 1 to aipcount for 
changes in economic conditions affecting everyone during this 
period. 



1. Figure A-1 is the same as Figure 7 in Chapter III. 
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TABLE A-1. ESTIMATES OF AVERAGE ANNUAL POST-PROGEIAM EARNINGS 
^ GAINS AT EACH STEP IN THE ANALYSIS^ 

At the End of : ^ ^ ' For Women For Men 



Step 


1: 


Obtaining the Basic 

Finding (in nominal dollars) 


l,100b. 




Step 


2: 


Accounting for Changing 
Economic Conditions 
(in nominal dollars) 


800^ 


-lOQC 


Step 


3: 


^ Also Accounting for the 
Unusually Low Earnings in 
the Year Before Training 
(in nominal dollars) 


900b 


-lOQC 


Step 


4: 


Also Accounting for ' 
Inflation (in 1980 
dollars) 


1 , 100^ 




Step 


5: 


Also Accouating for Individual 
Socioeconomic Differences 
(in 1980 dollars) 


1 , 300^ 


200C 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey and the March 1976 Current Population 
Survey supplemented by individual Social Security 
earnings records • 



a. For persons over 24 years of age and in CETA training more 
than seven days. 

b. Significant at the 0.01 level. 

c. ^ Not significant at the 0.05 level. 
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Figure A-1 . 



Earnings After Training Relative to the Past LongTerrfi Earnings Trend 
of a CETA Participant Who Experienced a Post-Program Earnings Gain 




Time (In Years) 

KEY 

X = Actual annual earnings 

O ' Predicted annual earnings without training 

A, and C = Difference between actual and predicted earnings 
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Step 3; Accounting for Participants^ Unusually Low Earnings In 
the Year &efor§ Thfey Entered Training 

Male participants earned an average of roughly $1,200 (in 
nominal dollars) below their earnings trend, and female 
participants earned an average of $400 below their earnings trend 
in the year before they entered a training program. Appendix B 
estimated the rate at wjiich these **pre-program dips** probably 
would have disappeared in the absence of training* This rate 
(which was quite fast) was used to estimate the portion of the 
pre-program dip that would have remained without training (less 
than $100, on average, for both male and- female participairts — see 
Appendix B) , and the results of Step 2 were adjusted to account 
for this factor. 

Step 4; Accounting for Inflation 

Estimates of post-program earnings gains were based on data 
for several different years • To combine these results in cons is— 
tent monetary units, they were all expressed in 1980 dollars, 
using the Personal Consumption Expenditures component of the 
implicit price deflator for Gross National Product. 

Step 5; Accounting for Individual Differences in Personal 
Characteristics 

Results to this point accounted for individual differences in 
past earnings trends, which in turn accounted for individual 
differences in i^easurable factors, such as age and education, and 
unmeasurable factors, such as motivation, that affect potential 
future earnings. However, to the extent that some of these 
measurable factors predict likely changes in behavior that produce 
substantial future deviations from past earnings trends, it was 
necessary to account for these factors explicitly in the analysis. 

This was done by including a variety of personal characteris- 
tics as independent variables in the regression model described 
below. 2 Doing so raised the estimate of the effect of training 



2 . Personal characteristics included were age , age squared , 
education level, education level squared, family size, 
minority status, and whether or not the individual: was a 
household head; was currently married; was never married; had 
childi;en under 4; had children between 4 and 6; and had 
children between 7 and 18. 
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for women from $1,100 to $1,300 and changed the estimate for men 
from an insignificant -$100 to an insignificant +$200. 



THE DATA - 

Estimates of the effect of training were based on data from 
the Continuous Longitudinal Manpower Survey folr 3,223 CETA 
participants and data from the March 1976 Current Population 
Survey for 30,668 comparison group members. The participant 
sample contained 932 women and 677 men who had been in classroom 
training, 236 women and 414 men who had been in on-the-job 
training, and 447 women and 517 men who had been in work 
experience programs. Tables A-2 and A-3 describe these groups. 

In addition to the survey data, individual earnings data for 
many years before training and up to three years after training 
were available from each CETA participant's Social Security 
records Data for two post-program years were obtained for almost 
all participants, and data for the third post-program year were 
obtained for about half of the participants. Corresponding Social 
Security earnings data were also obtained for all comparison group 
members • The validity of these longitudinal earnings data was 
examined in Appendix C and found to be quite satisfactory. 

The sample of participants "was composed of persons over 24 
years old who entered CETA classroom training, on-the-job tr^ain- 
ing, or work-experience programs (not public service employment) 
between January 197^^ and June 1976 and stayed in the program more 
than seven days. Persons over 24 were chosen to focus on adults 
with meaningful past earnings experience. Participants in public 
service employment were excluded to focus directly on CETA's com- 
prehensive training title. Persons entering between January 1975 
and June 1976 were chosen because they were the only groups for 
which appropriate data were available at the time of the 
analysis. And persons staying in the program for more than seven 
days were selected both to ensure a minimal exposure to training ^ 
and to be consistent with the criterion used by Westat, Inc., in 
previous analyses of these data.-' 



3. See Westat, Inc., Continuous Longitudinal Manpower Survey; The 
Impact of CETA on Participant Earnings, Working Paper No. 2 
(U.S. Department of Labor, June 1980), p. 2-3. 
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TABLE A-2. CHARACTERISTICS OF FEMALE PARTICIPANTS AND COMPARISON GROUP MEMBERS IN THE SAMPLE^ 



Classroom 
Training 



On-the-Job 
Training 



Work All CETA 

Experience Training 



Comparison 

Group 

Member's 



1(9 
3V 

11,I 

3.7 

47 
35 
13 
51 

9 

6 

14 



Average Number of Days in CETA- 150 

Average Age 34 

Average Years of Education 

Completed 10.9 

Average Number of Family 

Members 3.7 

Percentage Minority 54 

Percentage Currently Married 32 

Percentage Never Married 13 

Percentage Formerly Married 55 

Percentage with Children 

Under 4 10 

Percentage with Children 

Between 4 and 6 5 

Percentage with Children 

Between -7 and 18 13 



120 
35 

11.4 

3.4 

41 
45 
12 
43 

11 

8 

14 



162 
37 

11.5 

3.7 

36 
38 
15 
47 

7- 

7 

15 



41 
12.5 

3'. 5 

19 
77 
6 
17 

17 

21 



NOTE: All information pertains to the date of entry for CETA participants and to March 1976 for 
comparison group members. 

a. Includes only persons who were over 24 years old and, for CETA participants, also includes 
' only persons who were in a training program for more than seven' days. 
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TABLE A-3. CHARACTERISTICS OF MALE PARTICIPANTS AND COMPARISON GROUP MEMBERS IN THE SAMPLE^ 



' — 


Gla^sroom- 

Training 


"Gn-the-Jcrb - 
Training • 


" — —Work - — 
Experience 


All eETA-'— 
Training 


Comparison 

tJroap 

Members 


Average Number of Days in CETA 


132 


120 


139 * 


131 





Average Age 


33 


33 


36 


34 


39 


Average Years of Education 
Completed 


11.1 


11.3 


' 10.8 


11.0 


12.3 


•Average Number of Family 
Members 


J. 5 


3.2 


\ 

3.4 


3.4 


3.2 


Percentage Minority 


' 52 


32 


38 


42 


23 


Percentage Currently Married 


55 


62 


54 


57 ■ 


76 


Percentage Never Married 


27 


19 


25 


24 


14. 


Percentage Formerly Married 

Percentage" with Children 
Under 4 


18 

8 


19 

7 


21 
6 


19 
7 


10 
21 


Percentage with Children 
Between 4 and 6. 


5 


4 


7 


6 


17- 


Percentage with Children 
Between 7 and 18 


13 


12 


12 


12 


36 

* 



NOTE: All information pertains to the date of entry for CETA participants and to March 1976 for 
comparison group members. 

a. Includes only persons who were over 24 years old and; for CETA participants, also includes 
only persons who were in a training program for. more than seven days. 
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Participants were divided into two groups according to when 
they entered the program. The first group — referred to as 1975 
participants — included ^11 persons who entered between January and 
Aug ust 19 75* The se cond group — referred tcf^ as 1976_,partljc^^ 
— included all persons who entered between September 1975 and June 
1976. This split was made to minimize the timing mismatch for the 
definition of the year immediately before traihing (the year of 
the "p^re-program dip"). Because Social Security earnings data 
were only reported by calendar year, 1974 was defined as the pre- 
program year for 1975 participants and 1975 w^s defined as the 
pre-program year for 1976 participants . , The first post-program 
year for an individual member of either group was defined as the 
first full calendar year after that person left a training pro- 
gram. ' 

The comparison group was defined to include all persons from 
the March 1976 Current Population Survey who earned less than the 
maximum earnings reported by Social Security records in every year 
between 1970 and 1975; who were between 25 and 60 years old; and 
who were -members of families with incomes of less than $30,000 in 
1975.^ 

THE STATISTICAL MODEL 

The effect of CETA training was estimated from the following 
model: 

Yit «i +i-/3i • t + 7 • + 2 5j • Xji + et + e,^ (Al) 

apd 

^it = P • ^it-i + (A2) 



4. The maximum earnings covered by Social Security and thus 
reported by Social Security records were $7,800, $7,800, 
* $9,000, $10,800, $13,200, and $14,100 from 1970 ^through 1975, 
respectively. Persons in families wj.th incomes greater than 
$30,000 were eliminated to be consistent with analysis by 
Westat , Inc . , who supervised development of the data base. 
See Westat;, Inc., Continuous Longitudinal Manpower Survey; The 
Impact of CETA on Participant Earnings, Working Paper- No. 2 
(U.S. Department of Labor, June 1980), p. 2-2. 
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where : 

Yj^ = person i's earnings in year t; 

"^^ t =^~tinie (the last two digits of ""calendar year TJT 

one if year t was after person i terminated from 
training and zero otherwise (thus it was always zero 
for comparison group members); 

the jth personal characteristic for person i; 

a year-specific error component reflecting economic 
conditions; 

the individual error component for person 1 in year 

t; 

the random portion of person i's error component in 
year t; 

the intercept and slope of person i's earnings trend; 

the average effect of CETA training on future annual 
earnings; 

the coefficient for the jth personal characteristic; 
and 

a first-order serial correlation coefficient that 
varied by sex. 

Equation Al specifies separate earnings trends with 
parameters oc^ and i3j for each person in the sample. In addition, 
personal characteristics, Xjj , were included to account for 
systematic differences In likely deviations from past earnings 
trends. 

A dummy Variable, Tj^ , was included to distinguish observa- 
tions representing post-program years for participants from all 
other observations. Its coefficient, 7 , was the average- effect 
of training.. For some of the ^analyses, Tj^ was replaced by a 
separate dunnny variable to, measure the" effect of each major type 
of training. 

A-9 
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Tit = 

Cfj and /3j = 

7 = 

P = 



Equation Al specifies two error components. The first 
component, , represents the average effect of fluctuating 
economic conditions on everyone in the sample. The second com- 
P?.t_^4t. represents t he resu lt o f _id ip s^n^iraAiC™ en t^^ _a.f f ect- 
ing each individual • ^ 

Lastly, Equation A2 specifies a serial correlation process to 
represent possible relationships over time in the effects of 
individual idiosyncratic experiences. ^ 

The preceding model is an. extension of the fixed-effect model 
of heterogeneous earnings functions used by Kiefer (1979) The 
fixed-effect model specifies one person-specific parameter for 
each individual to account for unique characteristics that cannot 
be measured directly. Equation Al , however, specifies two 
, person-specific parameters per individual to account for 
unmeasured factors affecting both the underlying level and the 
change over time in individual long-run earnings potential. 

In addition, the model is a direct extension of covariance 
models used in econometrics to pool multiple time-series (see 
Pindyck and Rubinfeld (1976)) and is an application of interrupted 
time-series analysis used widely for evaluation research (see 
Campbell (1975)). 6 

*• 

THE ESTIMATION PROCEDURE 

The model was estimated in several stages in order to 
accommodate separate intercepts and slopes for each person and to 
incorporate the serial correlation structure. 



5. See Nicholas M. Klefet, "Population Heterogeneity from Panel 
Data on the Effects of Vocational Education," Journal of Poli- 

" tical Economy , vol. 87. no. 5, pt. 2 (October 1979), pp. 213- 
26- 

6. See Robert S. Pindyck and Daniel L. Rubinfeld, Econometric 
Models and Economic Forecasts (McGraw-Hill, Inc., 1976), pp. 
203-06. Also see Donald T. Campbell, "Reforms As Experi- 
ments," in Elmer L. Struening and Marcia Guttentag, ' eds."", 
Handbobk of Evaluation Research; Vol. 1 (SAGE Publications , 
1975>, pp. 75-86. ^' 
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Estimating Individual Trends 

Estimates Oj and j3j of the intercepts' and slopes, and /Jj , 
-Were obtained from pre-programryear earnings, data for 1970,.thrpugh 
1973 (excluding the year immediately before participants began 
training)* Thus by definition: 

+ Pi • t = + /Jj • t + Wjt (A3) 

where Wjt is a random error. Substituting Equation A3 into Equa- 
tion Al yields: 

+ 6,. - Wj^ (A4) 



or 



DEVi, = 7 • + S + et + e^^ - Wj^ (A5) 

where DEVjt , person i's observed deviation in year t from his or 
her estimated trend, can be computed directly from post-program 
earnings data for participants and corresponding data (for 1976 
through 1978) for comparison group members. 

Incorporating Serial Correlation 

The next step was to incorporate the serial correlation pro- 
cess, in order to account for the unusually low earnings exper- 
ienced by participants in the year before they entered training. 
This was accomplished as follows. Equation A2 implies that: 

= • ^it-s V,'- ^ (A6) 

where t-s is the year before entering a CETA program (or a corre- 
sponding year for comparison group members), t is a ppst-program 
year (or a corresponding year for comparison group members), and 
V'/' is a linear combination of person i's random individual error 
cotaponents for years t-s through t. Substituting Equation A6 into 
Equation A5 yielded: 

DEVit = 7 • Tit + SSj • Xji + 6t + / • 6it_3 + Vit' --Wit ■ (A7) 

Because e^^_^ and Tj^ were correlated (participants had a 
pre-program dip but comparison group members did not), ignoring 
e|t would produce estimates °f 7 ^ the effect of tr^iniji&^hat 
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contained a bias proportional to . Because p appeared to be 
q^uite small (see Appendj.x B) this bias was probably also quite 
smalls Nevertheless it was eliminated as follows* ' - 

^it-s was estimated by ^it-s , the observed deviation from the 
1970-1973 trend, in the year before participants entered a train- 
ing program and in a corresponding year for comparison group 
members*' p was estimated as described in Appendix B separate- 
ly for men and women. Substituting ^.^^^ andej^^gin 
Equation A7 yielded: 

+ + Vit' - Wit (A8) 
s 

where Zjj was the error in' estimating P • ^jt-s (which was corre- 
lated with • ?it-s , but was independent of T^^ and the X-j )• 
Subtracting p^ • ej^^g from both sides of Equation A8 and simplifying 
the notation yielded: 

DEVjt = 7 • Tit + • Xji + et + Uit . (A9) 

where DEVjj was the deviation from trend in post-prograi& year t, 
adjusted for the deviation from trend in pre-program year t-s and 
Ujt equalled Zj^ + Vjt - Wj^ . 

Accounting for Inflation 

The next step was to express the dependent variable in 1980 
dollars using the Personal Consumption Expenditures component of 
the implicit price deflator fox Gross National Product • This 
yielded: ^ * ' 

DEVjt* = 7* • Tit + • ^ji + ^t* ^it* ' (AlO) 
where the stars indicate values in 1980 dollars • 



/ 

7* 1974 and 1975 were used as comparison group counterparts to 
the year immediately before training in proportion to their 
occurrence as the pre-program year for participants. 

— ^.-^ 
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Estimating the Final Model 

To estimate Equation AIO from a pooled sample of data for 
different post-program years for participants and corresponding 
years (between 1976 and 1978) for comparison group members, it was 
expressed as: ^ 

DEVjt* = 7* • Tit • ^'i i'ni* • YR^ "it* ^^1 1) 

where the YRm were geparate dummj variables to represent 1976, 
1977, and 1978. * 

Variations of Equation AU were the basis for all* estimates 
of the effect of training. 
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APPENDIX- B. 



ACCOUNTING FOR THE UNUSUALLY LOW EARNINGS EXPERIENCED 
BY PARTICIPANTS IN THE YEAR BEFORE THE? ENTERED A 
CETA TRAINING PROGRAM ' - 



Figures 1 through 6 in Chapter III illustrate that the 
a\^erage earnings of CETA participants in the year before they 
entered training were noticeably below their past trend. To the 
.extent that . this "pre-program dip" was a temporary aberration^ 
^from '^i^h participants soon would have recovered withoOt 
training, their recovery should not be counted as part of the 
effect of the program. On the other hand, to the extent that this 
dip would have remained without training, participants' observed 
recovery ^ould be counted as part of the effect of training . 
Because of the magnitude of this phenomenon for male participants, 
its interpretation and' corresponding treatment can affect 
estimates of program impact for this group substantially. 

The best data available indicate that almost all of the pre- 
program dip would have disappeared in the absence of training b> 
the first or second post-program year (in other words, two to 
three years after the dip occurred). Final estimates of the 
effect of training were adjusted to takp. this factor into account 
explicitly, but because very little *of the dip was estimated 'to 
persist, this adjustment was minor (less than $100, on average, 
for both male and female participants). 

The following sections examine alternative explanations for 
the pre-^program dip, summarize estimates of the rate at which it 
probably would have disappeared in the absence of training, and 
outline how these estimates were obtained. 



ALTERNATIVE EXPLANATIONS OF THE PRE-PROGRAM DIP 

A -temporary pre-program dip of some magnitude was almost 
certainly produced by the fact that eligibility for CETA programs 
was based on short-term rather than long-term labor market exper- 
ience. This phenomenon is an example of a common statistical 
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artifact, generally referred to as regression to the mean.-*- It 
occurred as follows: ^ 

An individual * s earnings in any given year can be expressed 
as the sum of three components: ' 

t 

o a long-term component reflecting his or her underlying 
earnings potential; 

o a short-term component reflecting idiosyncratic events 
that uniq^uely affected him or her that year^ and 

o a short-term component reflecting economic conditions that 
affected everyone that year. 

The third component was accounted for explicitly in estimates, 
of the effect of training through the use of a comparison group 
(see Appendix A) .and was not a factor in the determination of the 
pre-program dip. 



The long-term component — commonly referred to as permanent 
income — is a function of individual personal characteristics such 
^s age, sex, race, training, education, motivation, and past 
experience. Because" of differences in these and other related 
factors, some persons can generally be expected to earn more than 
others, on average. 

In addition, everyone is, subject to idiosyncratic events — 
such as being fired because of a fight with the boss; having 
unusually good or bad luck finding a new job; being in the right 
place at the right time for a promotion; or being laid off by a 
bankrupt employer — that produce good years and bad years relative 
to one's earnings potential. 

Basing CETA eligibility only on recent experience eliminates 
many persons who have a relatively low earnings potential but have 
just experienced an unusually good year (i.e., persons with 
positive individual temporary earnings components). In addition, 
it establishes eligibility -for participation for persons with a 
somewhat higher earnings potential who have recently experienced 
an unusually bad year (i.e., persons with n^ative individual 



1. See Donald T. Campbell and Julian C. Stanley, Experimental and 
. Quasi-Experimental Designs for .Research (^and McNally and 
Company, 1966) , p. 10. » 
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temporary earnings components)* Furthermore, even among persons 
eligible for CETA, those who have recently experienced an 
unusually bad year are probably more highly motivated to apply 
than are those who have recently experienced an unusually good 

All of these factors work in the same direction to produce 
the result that CETA programs enroll a disproportionate number of 
persons' who have recently experienced an unusually bad year. 
Thus, their average individual short-term component is negative 
and their overall average earnings are below their "normal" long- 
term level • This average negative short-term component could 
(and, according to the empirical results reported below, does) 
explain the pre-program dip. . In future years, as random 
idiosyncratic events produce equal proportions of positive and 
negative individual temporary earnings components, overall average 
earnings will increase back to "normal" in the absence of 
training. 

On the other hand, it is Sometimes argued that persons who 
recently experienced a permanent decline in their future earnings 
recognize the permanence of this change and apply for CETA 
training. This would produce a pre-program dip that would not 
disappear in the absence of training. 

This explanation is based primarily on the experience of 
displaced workers who have lost specialized well-paying, stable 
jobs in declining regions or industries and have little prospect 
of regaining their former economic status. But CETA participants 
are disadvantaged individuals' with little previous work experience 
or with a history of low-paying, unstable jobs. Thus, the typical 
jo^ held in the past by CETA participants were probably not 
sp^ialized and. were unlikely to be any more difficult to replace 
than other past jobs had been. 

Therefore, although persons having just experienced an 
unusually bad year are probably more likely to apply for CETA 
training, it is unlikely that many CETA participants experienced 
large permanent declines from their already low unstable earnings 
patterns. Furthermore,, given the high variability in individual 
earnings for this group, ' it is unlikely that applicants could 
determine whether or not the decline they had experienced was 
permanent or temporary. 
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SUMMARif OF THE EMPIRICAL EVIDENCE 



Ideally, to measure the rate at which the pre-program dip 
would have disappeared in the absence of training, one / must 
observe what happened to persons who were identical to the CETA 
participants, but who did not enter the program.^ Unfortunately, 
without a true experiment based on random assignment of applicants 
to training and a control group, this was not possilile. 

Nevertheless, th^re were two independent sources of informa- 
tion from which to approximate the rate at which the pre-program 
dip would have disappeared without training: the past experience 
of participants, and the experience of comparison group members 
during the pre-to-post-program period. For both groups, yearly 
fluctuations in earnings disappeared quiclcly. 

CETA participants (especially men) experienced large, unre- 
lated year-to-year fluctuations in earnings before^ they entered 
the program. During this period, they both recovered rapidly from 
unusually bad years and failed to maintain the levels they reached 
during unusually good years. 

Similarly, there was little relationship between the relative 
performance of comparison group members during the pre-program' 
year (1974 or 1975) and the post-program years (1976-78). Persons 
doing unusually poorly or unusually well during the pre-program 
year were back on their trends by^ the post-program period, on 
ave^J'age. 

These findings were based on estimates of the correlation 
between deviations from trend in one year and subsequent devia- 
tions from trend. A strong positive correlation would indicate 
that such deviations disappeared slowly, whereas a weak positive 
correlation would Indicate a quick disappearance. A negative 
correlation (which was unlikely and did not occur) would indicate 
a systematic pattern of good years followed by bad years and vice 
versa*. - _ - ^ ^ 

Weak positive correlations (that is, deviations that dis- 
appeared rapidly) were observed for all groups. Based on these 
correlations and the average pre-program dip of $1,200 for male 
CETA participants and $400 for female participants. Table B-1 



2. These persons must be identical, on average , in terms of 
factors that af f ecf^f uture earnings. 
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indicates the portion of the pre-program dip thatf probably would 
have remained in the absence of training* The manner in which 
these fesults were obtained is explained later in this appendix. 

Judged by the past ability of male CETA participants to 
recover from uniisually bad years, virtually none of their 
pre-program dip would have remained in the absence of training. 
Judged by corresponding results for comparison group members, 
roughly 11 percent or $130 would have remained during the first 
year after training, 4 percent or $50 would have remained during 
the second year, and 1 percent or $10 would have remained duriiig 
the third year, on average. Similar results were obtained for 
women, although they were based on a smaller pre-program dip and a 
slower rate at which the dip disappeared^ 

Results injer^le B-1 for the comparison group were used to^ 
ad justr^-^e^iEMtfes of the effect of training- to account for the 
pre-program dip. This was done to reduce the chances of 
undercompensating for this factor* 



DESCRIPTION OP HOW THE RESULTS WERE OBTAINED 

Appendix A developed the following model to estimate the 
effect of training: 



and 



where: 



+ V: 



(Bl) 



(B2) 



Yit = 



t = 



'it 



person i's earnings in year t; 

time (the last two digits of calendar year t) ; 

one if year t is after person i terminated from training 
and zero otherwise; 

the jth personal characteristic for person i; 

a year-specific error coraponerit reflecting macroeconoraic 
conditions; 
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TABLE ESTIMATED PORTION OF THE PRE-PROGRAM DIP THAT WOULD HAVE REMAINED IN THE ABSENCE OF 

TRAINING 



First 
Post- 
J^rogram 
Year 



Second 
Post- 
Program 
Year 



Women 
Third 
Post- 
Program 
Year 



Average 
For The 
Post-Program 
Period^ 



First 
Post- 
Program 
Year 



Second 
Post- 
Program 
Year 



Men 

Third 
Post- 
Program 
Year 



Average 
For The 
Post-Program 
Period^ 



Based on the 

Past Experiencev of 

CEfA Participants 

v 

i 

In percents 12 4 
In Mollars^ 50 20 

Based on the 
Experience of 
Comparison 
Group Members 

In percents 27 14 
In dollars^ 110 60 



1 
0 



7 
30 



7 
30 



18 
70 



130 



0 
0 



4 
50 



0 
0 



1 

10 



0 
0 



6 

70 



a« Rounded to the nearest 10 nominal dollars • 

b. For an average post-program period of 2*5 years < 



•i 



^it 



the individual error component for person^i in year t; 
the random portion of person i's error component in year 

t; 

ttj and « the intercept and slope of person i's earnings trend; 

5j » the coefficient for the jth personal characteristic; 

7 « ' the average effect of CETA training on future annual 
earnings; and 

p =« a first-order serial correlation coefficient that varies 

by sex. * 

Th^ first-order serial correlation coefficient p measures 
the extent to which ^it-1 ; the deviation from ti;end in year t-1, 
persists in year t. Thus It provides a direct measure of the 
persistence of the pre-entry dip because: 

= • ^it-. + . (B3) 

where is the pre-entry dip (the deviation from trend in pre- 

entry year t-s) , s ^is the number of years between the post-pro- 
gram year t and the pre-entry year t-s, and Vj^' is a linear 
' combination of person i's individual random error components 
between years t-s and t. 

If p were one the pre-entry, dip would be permanent, and if 
p were zero the dip would be entirely temporary— that is, it 
would completely disappear on average by the next year. Between 
these two extremes the dip persists over time at the rate p^ 
For example, if p were 0.5 half of the dip would remain after 
one year, one-quarter or p^ would remain after two years, and 
one-eighth or p^ would remain after three years, on average. 

Basic Approach to Estimating P 

As previously indicated, P was estimated from the 

experience of comparison group members during the 
pre-to-post-program period. The estimation procedure used for 
this purpose is described below. The same procedure was also used 
to estimate p from the experience of CETA participants before 
they entered the program by redefining the time period involved. 
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Defining 1974 year t-s and 1976 as year t for the compar- 
ison group, one could, in theory, estimate p from Equation B3» 
A second estimate could be obtained Ijy redefining 1977 as year t 
and reestimating Equation B3. A third estimate could be obtained 
by redefining t as 1978. But Equation B3 requires data on the 
^ true deviations from trend, ej^ and ej^.g , which are not directly 
measui;able« 

Fortunately, estimates ( ^jt and ^it-s ) of these deviations 
5!0uld be obtained and were used instead. These estimates were 
obtained by computing a linear trend (estimating aj and jSj ).from 
individual earnings for four years before t-s and computing devia- 
tions from this trend in years t and t-s. 

was then regressed on ej^_g as follows: 

^it = ^ + • ^it-s + Vj^" (B4) 

Intuitively it would seem that^ from Equation B4 is the 
same as and thus provides a^ direct estimate of p . This is 
not true, however. Because ^jt and ej^^g were based on the same 
trend, which was estimated with error, they contained a common 
error component, which produced an artificial positive correlation 
between them. Thus simultaneously reflected two correlations: 
the artificial correlation due to the common error component and 
the true serial correlation. 

But estimates of can be transformed to eliminate the arti- 
ficial correlation and produce consistent estimates of p . These 
transformations are presented below. ^ 

For t corresponding to the first post-program year (two years 
after t-s) : 

2.5 - O.lp - 0.8p^ - 2.7p^ + O.ep"* + 0.5p^ 

^ = 1 4 (B5) 

, 2.5 - p - \.5p^ - p^ + p^ 

For t corresponding to the second post-prdgram year (three 
years after t-s) : 

3.0 - 0.15p 2.2p^ - 1.05p^ + OV - OV + 0.5p^ 

= (B6) 

2.5 - p - 1.5p^ - p^ + p"^ 



3. A derivation will be made available upon request. 
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And for t corresponding to the third post-program year (four years 
after t-s): 

3.5 - 0.2p - 2.6p^ - 2 V + 2 V - p' - 0.5p* + 0.5p' 

. = : ■■ ■ (B7) 

^ 2.5 -p ^ 1 V -P +P 

Corresponding expressions for p in terms of J/^ were not 
readily available, so a numerical conversion table was produced 
(see Table B-2) . Working from this table, estimates of i/Zg 
obtained by applying ordinary least squares to Equation B4 were 
transformed to obtain consistent estimates of p 

Findings for Women and Men 

The preceding analysis was conducted for the comparison group 
based on the relationship between their 1976, 1977, and 1978 (year 
t) deviations and their 1974 (year t-s) deviations from their 
1970-1973 trends. Resulting estimates of from Equation B4 and 
corresponding transformed values of p from Equations B5, B6, and 
B7 are presented in Table B-3. 

Estimates of p ranged from 0.20 to 0.43 and averaged 0.33 
for male comparison group members. Thus, on average^, roughly 33 
percent of a deviation from trend remained after ohe year, 11 
percent remained after two years, 4 percent remained after three 
years, and 1 percent remained after four years. Deviations from 
trend for women appeared td disappear less quickly, with estimates 
of p ranging from 0.45 to 0.57 and averaging 0.52. 

A similar analysis was based on the past earnings history of 
CETA participants. The experiences of 1975 and 1976 participants 
were considered separately.^ For 1975 participants, year t was 
defined as 1971, 1972, or 1973, year t-s was defined as 1969, and 
the trend period was 1965-1968. For 1976 participants, year t was 
defined as 1972, 1973, or 1974, year t-s was defined as 1970, and 
the trend period was 1966-1969. ^ 

Results for both groups of participants were similar, 
yielding serial correlation coefficients, averaging 0.t)6 for men 
and 0.34 for women. These coefficients were smaller than their 



4. As explained in Appendix A, 1975 participants were defined as 
persons who entered CETA programs between January and August, 
1975. 1976 participants were defined as entrants- between 
September 1975 and June 1976. 
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TABLE B-2. THE RELATIONSHIP BETWEEN p ASD^p^ 





i/i 


^3 


^4 


0.00 


1.000 


1.200 


lv400 


6.05 


1.019 


1.221 


.i;424 


0.10 


1.040 


1.242 . 


.1.448 


0.15 


1.063 


1.264 


1.472 


0.20 


1,087 


1.287 


1.496 


0.25 


1.112 


1.310 


1.520 


0.30 


1.139 


1.335 


1.545 


0.35 


1.167 


1.360 


1.570 


0.40 


1.195 


1.387 


1.596 


0.45 


1.224 


1.415 


1.624 


0.50 


1.253 


1.445 


1.652 


0.55 


1.282 


1.475 


1.682 


0.60 


1.311 


1.506 


l."714 


0.65 


1.339 


1.538 


1.747 


0.70 


1.367 


1.570 


1.780 


0.75 


1.392 


1.601 


1.815 


0.80 


1.415 


1.630 


1.848 


0.85 


1.436 


1.657 


1.879 


0.90 


1.452 


[ 1.679 


• 1.906 


0.95 


1.463 


1.694 


1.926 


1.00 


1.375 


2.250 


2.667 



SOURCE: Computations were based on Equations B5, B6, and B7. 
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TABLE ESTIMATES OF AND p 



Women Men 







P 




P 


Based on the Past 
Experience of CETA 
Participants 










For 1975 participants^ 
s-2 
s=3 
s=»4 


1.1497 
1.3436 
1.4254 


0.32 
0.32 
0.05 


1.0856 
1.2226 
1.4150 


0.20, 
0.05 
0.03 


For 1976 participants^ 
s-2 

s«4 


1.2262 

i. . jy£,u 
1.6366 


0.45 
0.41 
0.47 


0.9987 
1.22L02 
1.4125 


0.00 
G.05 
0.03 


Based on the Exper- 
ience of Comparison 
Group ^Menibers 

s=2 
s-3 
s=4 


1.2964 
1.4713 
1.6225 


0.57 
0.54 
0.45 


1.2106 
1.3598 
1.4976 


0.43 
0.35 
0.20 



a. Participants over 24 years old who entered between January and 
August, 1975, and stayed in the program more than seven days. 

b. Participants over 24 years old who entered between September 
1975 and June 1976, and stayed in /the program more than seven 
days 



counterparts for comparison group members. As indicated 
previously, however, the average results for comparison group 
members ( p 0.3 for men and p 0.5 for women) were used to 
adjust for the pre-program dip in estimates of the effect of 
training (see Appendix A) . This was. done to reduce the likelihood 
of undercompensating for this factor. 
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APPENDIX C. VALIDATING THE SOCIAL SECURITY EARNINGS DATA 



Two potential problems with Social Security earnings data are 
frequently cited— changes over time in the coverage of certain 
dccupations, and truncation due to the upper bound for reported 
earnings. The following analysis indicates that these factors 
probably had a negligible effect on estimates of the effect of 
CETA training reported in this paper. ^ 



CHANGES IN SOCIAL SECURITY COVERAGE 

Not all jobs are covered by Social Security and thus not all 
earnings are reported by Social Security records. Therefore, 
earnings reported by Social Security records could artificially 
change because of changes in coverage (due to the increase over 
time in occupations covered by Social Security or due to 
individual shifts from covered to uncovered employment or vice 
versa). If this phenomenon occurred and if it affected CETA 
participants and comparison group members markedly differently, it 
could bias estimates of the effect of CETA training programs. 

The likely magnitude of this potential bias was approximated 
by comparing Social Security earnings data for CETA participants 
with survey-based earnings data for the same group during the year 
before and the first year after training. ^ Comparable data for 
comparison group members were not available because survey earn- 
ings data were available only for one year. 



1. The truncation problem examined below 'only concerns 
measurement error in the dependent variable. It does not 
include the statistical problem of truncated samples. 

2. Survey-based earnings data were obtained from the Continuous 
Longitudinal Manpower Survey. Survey data were also available 
for the second year after training, but only for a portion of 
the sample. 
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T^ble C-1 reports the ratio -of mean earnings according to 
Social Security data relative to mean earnings according to survey 
data.^ In almost all cases, thdLs ratio was close to one, indicat- 
ing' a high degree of cohsistehcy between the two independent 
sources of earnings data.^ 

More important, however, is the fact that this ratio changed 
very little over time. It was 1.05 for female CETA participants 
in the year before training and 1.00 in the year after training, 
representing a 5 percent decrease (see Table CI). Corresponding 
results for male participants were 0.97 and 0.93, or a 4 percent 
decrease. Roughly. comparable changes were experienced by partici- 
pants in each of the different types of training. 

To estimate the likely bias due to the preceding decreases 
in Social Security earnings coverage requires an estimate of the 
corresponding shift in coverage for comparison grbup members. 
Direct information about this shift was not available. But' 
because there was no change in the Social Security law affecting 
the occupations that were covered during-' the analysis period, 
there was probably no shift in average coverage for the comparison 
group. 

Thus the maximum likely relative shift for participants (the 
difference between their shift and that of comparison group 
members) was a^ 5 percent decline for women and a 4 percent decline 
for men. Based »on the average first post-program-year earnings of 
$4,300 and $6,800 for female and male participants, respectively, 
these declines imply maximum likely negative biases of roughly 
$200 and $300 in estimates of the effect of training — not enough 
to affect the conclusions of this .paper. 



3'. Earnings were expressed in constant dollars to control for the 
slight timing mismatch between the Social Security and 
survey-based earnings data. 

4# Both Social Securit;^ and survey-based earnings data contain 
random measurement error and thus are not as consistent for 
each individual as they are for group averages. These 
individual errors cancel each other and do not affect grouf> 
averages appreciably. Because estimates of the effect of 
training are based on group averages, they are not biased by 
individual random measurement error in the dependent variable. 
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TABLE C-1. THE RATIO OF AVERAGE ANNUAL EARNINGS ACCORDI% TO SOCIAL 
SECURITY DATA AND AVERAGE ANNUAL -EARNINGS ACCORDItfG TO SURVEY 
DATA^ • ' 



Men 





Year 


Year 


Per- 


Year "^/^ 


Year 


^er- 


r 


Before 


After 


cent 


Before:^'^\ 


''After 


/:ent 




Training 


Training 


Change 


Training '""^^Igpining 


CJiange 


All CETA Training 


1.05 


1.00 


-5 


0.97 


"0.93 y 


V -A 

s 


Classroom training 


1.07^ 


1.05 


1 

-2 




0.99 . 


} • 
-7 


On-the-Job training 


1.00 


0.89 


-11 


0.9J8'^ 


0.95 


-3 


Work experience 


1.03 


0.98 


-5 ' 


0.85' 




-4 



a. ' Earnings from both data sources were expressed in 1980 do^-J 



But this bias was probably even smaller, due to a potential shift in 
the coverage of earnings by the surveys. Pre-program earnings data were 
obtained from surveys administered while participants were in the pro- 
gram. Thus participants may have understated their- pre-program earnings 
to protect their eligibility for the program. This was less liHely to be 
the case for the post-program earnings - data obtained from- surveys admin- 
istered after participants had left the program. Thus- the ratfolQ^ Social 
Security to survey earnings may have overstated Social Security'' coverage 
during the pre-program year but riot during the post-prog^an year." If thjs 
were the case, the previous estimate of the decline fit participants 
Social Security coverage between these two years woUld be too^ large. 

Because of the small size of this potefottlal bias and lack of more 
precise Information, estimates of the effect of training v^ve not adiusted 
explicitly for it. ^ l.x'X^^^^-J^ 



THE SOCIAL SECURITY REPORTING MAXIMUM 



Oniy earnings up to a specified limit are covered by Social 
Security taxes, so earnings ^re reported only up to this limit. ^ 
If a substantial number of participants or cogiparison group 
members reached this limit for a number of years and this problem 
occurred '^^rore frequently during the pre-prdgram period than it did 
during the post-program period (or vice-versa) and this dispropor- 
tionate occurrence was more pronounced or entirely different for 
CETA participants than it was for comparison group members, then 
estimates of the effect of CETA training might be biased. 

But f ew CETA participants or comparison group members ever 
reached the Social Security earnings maximum during the 1^70-1978 
pre-to-post-program^^nalysis period (see Table C-2) . This was 
especially true, for ^female participants and for all comparison 
group members. ^ 



TABLE C-^. PERCENTAGE OF THE SAMPLE THAT REACHED THE SOCIAL 
SECURITY EARNINGS MAXIMUM BETWEEN, 1970 AND 1978^ 



Women Men 



Percentage 






Three or 






Three or 


'Who Reached 


»One 


Two 


More 


One 


■ Two 


More 


the Maximum 


*Time 


Times 


Times 


Time 


Times 


Times 


All CETA Training 


1 


0 


0 


6 


' 3 


5 


Classroom training 


1 


1 


0 


7 


3 


5-5. s 


On-the-job training 


, 2 




0 


7 


4 


9 


Work experience 


1 




0 y. 


4 


3 


2 


Comparison Group 


0 


0 ^ 


0 ■ 


3- - 


1 


0 



a. Percentages do, not sum across different types of training 
because the bas6 for each group was different. 



5. This upper bound was $7,800, $7,800, $9,000; $10,800, 
$13,200, $14,100, $15,300, $i6,50O', and $17,700 during the 
^ years 1970-1978, respectively (the analysis period for this 
study). , • 
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The 14 percent of the male participants who ever reached the 
earnings maximum during the nine-year analysis period did so pri- 
marily during the pre-program period (see Table C-3).^ This prob- 
ably produced a slight underestimate of post-program earnings in 
the absence of training, which probably overestimated the effect 
of training for men slightly. But due to the small proportion of 
male participants involved and the relatively infrequent occur- 
rence of this phenomenon, its effect, was probably negligible. 



TABLE C-3.* PERCENTAGE OF MALE CETA PARTICIPANTS WHO REACHED THE 
SOCIAL SECURITY- EARNINGS MAXIMUM DURING THE PRE- 
PROGRAM AND POST-PROGRAM PERIODS 



Number of .Times Number of Ti&es 

During the Pre^ During the Post-Program Period 

Program Period 0 1 ^ 

0 86 1 0 

1 5 0 0 

2 3 0 ' 0 
3+ 4 1 - . 0 



6. From 5 to 9 percent of the m^le participanta^eached the earn- 
ings maximum in any given year during this beriod . 
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APPENDIX D. ESTIMATING THE BIAS CAUSED BY CETA PARTICIPANTS IN 
THE COMPARISON GROUP 



Because the comparison group was drawn from a national sample 
of U.S. residents (the Current Population 'Survey), it probably 
contained' unidentified CETA participants. But the likely 
percentage of such unidentified participants was negligible and 
thus the effect of their presence (frequently referred to as 
contamination bias) was negligible. 

NATURE OF THE PROBLEM ^ * 

The model used to estimate the effect of training can be 
expressed as:^ 

Yit = f(Yit-s' Xj) + • Tqit + 7, • Cj^ + Uj^ (DO 

where: 

Yjt = -person i's earnings in year t; , 

X.) = person i's expected earnings in year t_without training, 
' according to a vector of past .earnings Y■^^_^ and a vector 
jof personal characteristics, Xj j 

T > = one if person i had participated in the qth type of CETA 
^ training (classroom training, on-the-job training, or work 
•experience) before year t, and zero otherwise; 

. (t.t = one if person i was a comparison group member and year t 
was a year corresponding to a post-program year for 
participants, and zero otherwise; 



-s 



To simplify the discussion, this appendix expresses the basic 
model somewhat differently from the way it is expressed else- 
where in this papers It also Ignores the minor adjustment^ for 
the pre-program dip and the adjustment for inflation, neither 
of whi<:h would affect the conclusions of this appendix. 
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and 7^ =« mean deviations from expected earnings for the qth type of 
training and the comparison group, respectively; and 

Uj^ = a random disturbance* 

Iq , the estimated impact of training type q, can thus be 
expressed as: 

Iq = 7q - 7^ . — (D2) 

A A 

where 7q and 7c are estimates of 7q and 7c . If there were no 
CETA participants in the comparison group then: 

E^V = - (D3) 

and, in the absence of any other problems, one would obtain 
unbiased estimates of the impact of each type of training. 

But if the comparison group contained CETA participants in 
proportion TTq, where: 



then estimates 7c obtained from Equation Dl would be biased. 
Consequent 
note that: 



Consequently, estimates 1^ would also be biased. To see this 



and 



E(^q) = . . (D6) 



Tl^^s: \ E(Iq) = E<7q) - E(7^) ' (D7) 

= ^q - • - ^ TTq • 7q 



and BIAS(Iq) = BJ^) - 1^ / (D8) 



0 -7r,)7, - STTq -7^ 



4 
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That is, the bias depends on the contamination proportions, 
■jTq. If they were all zero (i.e., if there were no CETA partici- 
pants in the comparison group) there would be no bias. But as 
these proportions increase, other things being equal, the bias 
increases.^ 



MAGNITUDE OF THE PROBLEM 

To estimate the contamination bias, one must estimate the 
contamination proportions. Estimates of the largest likely pro- 
portions were obtained as follows for minority and non-minority 
men and women. 

First, the size of the populations represented by the par- 
ticipant and comparison 'group samples were computed by summing 
their sampling weights accordingly (see Table D-1). Contamination 
proportions were then approximated by the ratio of the size of the 
participant population to the size of the comparison group popula- 
tion (see Table D-2) . 

For example, the sum of the weights for minority females 
indicated a participant population of 57,900 persons and a compar- 
ison group population of 5,530,900 persons. Thus 57,900/5,530,900 
or 0.010 of the comparison group probably entered CETAtraining 
between January 1975 and June 1976. The .corresponaing_re8ult8_f or^ 
non-minority females, minority males, and noTFmlnorT^ males were 
contamination proportions of 0.002, 0.013, and 0.005, respect- 
ively. 

To complete the analysis, the presence of other CETA partici- 
pants (public -service employees and participants in multiple 
activities) plus earlier CETA participants (who entered in 1974) 
and later CETA participants (who entered by 1978) were accounted 
^for as follows. The ratio ■ of all CETA participants (including 
those in public service employment and multiple activities) over 
24 years old who entered the program between January 1975 and June 
1976 and stayed for more than seven days, to CETA participants 
included in Tables D-1 and D-2 was about 2.0.-^ In addition, 
according to data from Bassi (1982, p . 85 ) , the ratio of all CETA 



2. For positive . 



3. This ratio was estimated from the Continuous Longitudinal 



Manpower Survey. 

» 
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TABLE D-1. PARTICIPANT AND COMPARISON GROUP POPUUTION SIZE BY SEX, MIN- 
ORITY STATUS, AND TYPE OF TRAINING^/ 



Women Men 



Non- Non- 
^ Minority^/ Minority^ MinorityV MinorttyV 



All CETA Participants 


57,900 


64,700 


55,800 


77,000 


In classroom training 


37,600 


30,500 


27,900 


24,400 


In on-the-job training 


7,000 


10,000 


10,900 


22,400- 


In work experience 


13,300 


24,200 


17,000 


' 30,200 


Comparison Group Members 


5,530,900 


27,508,700 


4,293,400 


16,865,600 



SOURCE: Estimates were derived from the Continuous Longitudinal Manpower 
' Survey and the March 1976 Current Population Survey, 

a- For persons over 24 years old and in CETA training for more than seven 
days. 

b. Non-minority persons included all white, non-Hispanic persons. 
Minority persons included everyone else. 

/ 

TABLE D-2. CONTAMINATION PROPORTIONS RESULTING FROM 1975-1976 ADULT CETA 
PARTICIPANTS BY^SEX,_ MINORITY^ 



Women Men 







Non- 

MinorityV Minority^/ 


MinorityV 


Non- 

MinorityV 


All 


CETA Participants 


0.010 0.002 


0.013 


0\005 


In 


classroom training 


0.007 0.001 


0.006 


0.001 


^ In 


on-the-job training 


0.001 0.000 


0.003 


0.001 


In 


work experience 


0.002 0.001 


0.004 


0.002 


a. 


For persons over 24 years 
days. 


old and in CETA training for more 


than seven 


b. 


Non-minority persons included all white. 
Minority persons included everyone else. 


non-Hispanic 


persons. 
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entrants from the beginning of the program in 1974 through the end 
of the analysis period in calendar year *1978, to all entrants 
between January 1975 and June 1976 was about 3»1»^ 



To account for the presence of these additional participants 
in. the comparison gtoup, each of the contamination proportions in 
Table D-2 was multiplied by 2.0 timJfe 3.1 or by 6.2. But this did 
not affect the results appreciably (see Table D-S) . On balance it 
appeared that contamination bias was probably negligible. 



TABLE D-3. CONTAMINATION . PROPORTIONS INCLUDING ALL 1974-1978 
ADULT CETA PARTICIPANTS BY SEX AND MINORITY STATUS^ 





Womeii 


Men 




Non- 


Non- 




Minority Minority 


Minority Minority 


Adult CETA 




0.081 0.031 


Participants 


0*062 0.012 



a. For persons over 24 years old and in cklA training, public 
service employment, or multiple activities more than seven 
days. 

b. Non-minority persons included all white, non-Hispanic per- 
sons. Minority persons included everyone else. 



4. See Laurie Jo Bassi, "Estimating the Effect* of Training Pro- 
' grams with Nonrandom Selection," draft of Ph.D. dissertation. 
Economics Department, Princeton University (1982). 
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APPENDIX E. FINDINGS BY OTHER STUDIES ABOUT THE RELATIVE 'EFFECT- 
IVENESS OF CLASSROOM TRAINING, ON-THE-JOB TRAINING 
AND WORK EXPERIENCE 



Westat, Inc. (1981), Taggart (1981), the U.S. General 
Accounting Office (1982) and Bassi (1982) used the Continuous 
\Longitudinal Manpower Survey to. examine J:he effect of CETA train- 
ing on participants' post-program earnings. 1 The first three 
studies used the same estimates of this effect— those obtained 
originally by Westat, Inc. These studies are hereafter referred 
to as Westat, et al. Bassi obtained independent estimates using a 
different statistical estimation procedure. 

The results of these studies were similar in many respects to 
the results presented in this paper. But a key finding by Westat, 
et al— that on-the-job training worked best by a substantial 
margin—is directly contrarji; to the result of the present analysis 
of no statistically 'Significant or substantively large difference 
among the effects on earnings of classroom training, on-the-job 
training or work experience. 

As indicated below, however, ^ finding by Westat, et al 
that on-the-job training was most ef«,ctive was based on a statis- 
tical model that undercompensated for the fact that participants 
in on-the-job training consistently earned more than participants 
* in classroom training or work experience before they entered a 
CETA program.- 



1. See Westat, Inc., Continuous Longitudinal Manpow er Survey; Net 
Impact Report No. 1 (U.S. Department of Labor, March 1981). 
See Robert Taggart, A Fisherman's Guide; An Ass essment of 
Trai nine and Remediation Strategies (W.E. Upjohn Institute' for 
Employment Research, 1981). sii U.S. General Accounting 
Office, CETA Programs For Disadvantaged Adults— Wha t Do We 
K now About Their Enrollees. Services and Eff ectiveness? 
(June, 1982). And see Laurie Jo Bassi, "Estimating -the Effect 
of Training Programs With Nonrandom Selection,"- draft of 
Ph.D. Dissertation, Economics Department, Princeton Univer- 
sity (1982). 
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The principal findings of these past studies are described 
below* Then a detailed discussion of the problem with the 
statistical inodel used by Westat, et al is presented. 

SUMMARY OF FINDINGS 

Bassi found large programs-induced earnings gains for female 
participants with no clear pattern of differences by type of 
jiraining. In addition, she found that female participants with 
the least past earnJtngs experienced the largest earnings gains and 
that earnl,ngs gains for minority women were somewhat smaller than 
those for non-minority women* 

Bassi concluded that the matched comjparison groups for male 
participants developed by Westat, Inc., for' the Continuous Longi- 
tudinal Manpower Survey (upon which she based her analysis) were 
not suitable for estimating the effect of training. Thus, except 
for one subgroup, she did not present results for men. — 

« 

Westat, et al found: large -earnings gains fot female 
participants; that the largest gains ^accrued to women with the 
least past earnings; that earnings ^gains increased with the length 
of training; and that earnings gains were due mostly to increajsed 
empj-oyment. In addition, they found small earnings gains for men 
that were not statistically significant, on average. These 
results we're basically consistent with the results of the present 
analysis. But contrary to the results of the present analysis, 
Westat et al found that on-the-job training was substantially more 
effective than classroom training or work Experience in increasing 
the post-program earnings of participants. 

PROBLE^^S WITH THE STATISTICAL MODEL UPON WHICH 
THE RESULTS OF WESTAT et al WERE BASED 

The- following is a discussion of why the mo^el upon wftich the 
results of Westat et al were ba^d undercompensated for the fact 
tha^t participants in on-the-job* training consistently earned more 
than participants in classroom training and work experience before 
they entered a CETA progifam. 

The Statistical Model 

^ The model u^ed by Westat > et al to estimate .the effect of 
training can be expressed as: 
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where : 



= person i's earnings in post-program year t and pre-program 
year t-s; 

Xjj = the jth personal characteristic for person i; 

T = one if person i had been in training activity q (classroom 
^ training,' on-the-job training, or work experience) and 

zero otherwise; 

7q = the average effect on future earnings of training type q; 

b and 5: = other parameters to be estimated; and 

s J 

Uj^ = a -random disturbance. 

<* 

■ Numerous versions of this model (first developed by Orley 
Ashenfelter (1978) and conmonly referred to as an autoregressive 
. earnings model) were used, yielding a broad range of results. 

Probletas with the Model 

For reasons explained below, autoregressive earnings models 
do not fully compensate for. differences in the average pre-program 
earnings of different -groups. Thus . part of these initial 
differences are reflected in estimates of the relative effect of 
training. 

Table E-1 indicates that participants in on-the-job training 
consistently earned more before entering CETA t^han their counter- 
• parts in classroom training and work experience did. By under- 
correcting for these differences, autoregre^ve models will over- 
estimate the effect of on-the-job training ^relative to that of 
classroom training and work experience. 

The following is a brief explanation of why this problem 
occurs. To simplify the discussion without limiting its 



2. See Orley Ashenfelter "Estimating the Effect of Training 
Programs on Earnings," The Review of Economics and Statistics, 
vol. LX, no. 1 (February 1978), pp. 47-57. 
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TABLE E-1. AVERAGE PRE-PROGRAM EARNINGS BY SEX, TYPE OF TRAINING, 
AND PRE-PROGRAM YEAR (In nominal dollars)^ 



Sex and • , 

^ype of Pre-Program Year 

Training 1970 1971 1972 1973 1974 



Female CETA Participants 

In classroom training 730 810 1,010 1,240 1,370 

In on-the-job training 890 1,020 1,280 1,500 1,660 

In work experience 570 610 750 930- 1,070 



Male CETA Participants 

In classroom training- 1,400 1,540 2,040 2,640 2,800 

In on-the-job training 1,760 1,990 2,670 3,^80 3,590 

In work experience 1,130 1,220 1,540 1,840 1,780 



SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey supplemented by "individual Social 
Security earnings records. 

a. For persons of all ages in CETA training -for more than seven 
days. 



generality, the personal characteristics X;: were deleted from 
Equation El yielding :3 

. ' = a + 2b3-Yij_3 + 27q-Tqit + U^^ (£2) 

^ 4 



3 . Problems of covaria'fice adjustments such as those produced by 
the personal characteristics are widely recognized. For 
example, see S. Director, "Underad justment Bias in the Evalua- 
tion of Manpower Training, " Evaluation Quarterly , vol. 3, 
(May 1979). - 
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Past studies indicate that earnings increase at a decreasing 
rate throughout one's working life.^ For shorter periods (teh 
years or less) earnings profiles are approximate^ linear • 
Estimates of the effect* of training based on autoregressive 
earnings models such as Equation E2 are biased when the profiles 
(either linear or nonlinear) of participants (by type of training) 
and comparison group members are different (which was the case for 
the Westat, et al analysis). For example, linear earnings 
profiles imply that: 

= ttj + ^i-t + 27q-Tqit + Uj^ (£3) 

\where and j3j are the intercept and slope of person i's pre- 
program earnings profile. Now consider the results of estimating 
the effect of training using an autoregressive earnings model from 
data generated by Equation E3. 

Start with a first-order autoregressive model — one based on a 
single pre-training year — with s years between the post-program 
year and the pre-program year. Differencing Equation E3 accord- 
ingly yields: 

- Yit_3 = 2 7q • Tqit + V-^' 
= Yit_3 + Z 7q • Tqit + Ui^' 



(E4) 
(E5) 



where Uit' = S • ^i + Ui^ - Ui^.^ (E6) 



Using Equation E5 to determine the effect;^ of training 
involves estimating coefficients for both ^iis ^qit • 

coefficient for Yj^^^ were estimated without bias (by constraining 
it to one as in Equatio-n E4') the estimated coefficient for T^j^ 
would be biased because of the correlation between T^jj and /3j in 
the error term. For example, if participants' earnings were 
increasing more slowly than those of comparison group members (Tqit 
and /Jj were correlated negatively) the coefficient for Tqit (th'e 
effect of training activity q) would be underestimated. 
Furthermore, the magnitude of this bias would increase as s, the 



/ 

4. See J. Mincer, Schooling, Experience and Earnings (National 
Bureau of Economic Research, 1971). 
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number of years between the pre-program year and post-progr;ani 
year, increased. 



Additional Problems arise from bias in the estimated 
coefficient for Yj^^g because of the correlation between Yj^^g and 
l3| , controlling forT^j^. And, lastly,- if U||^^^and ^Uj^^^^ were 
serially correlated, another source of bias would exists ^ 

Unbiased training effect estimates would result only if: (1) 
the earnings profiles of comparison group members and participants 
in all three types of training were identical (in which case, it 
would be unnecessary to control for past earnings to eliminate 
bias) or (2) the biases mentioned above cancelled each other (a 
remote possibility) • 

The preceding' result generalizes to higher-order 
autoregressive .^models by further differencing Equation E3 and 
generalizes to nonlinear earnings profiles by substituting an 
appropriate functional form into Equation E3« For, example, one 
might substitute ln(t) for t to represent earnings that 'Increased 
over time at a decreasing rate. 

I 



«3> 
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APPENDIX F. COMPONENTS OF THE AVERAGE EARNlflg'^^^XN^ EXPERIENCED 
BY 'female PARTICIPANTS -^L'''"^ 



4g4 



Chapter* III indicated that- most of the av^rage^rnings gain 
experienced by female CETA participants wps due tcr^n^ip^^^^se in 
the , amount of time they worked rather than in^reaTOd jc^age rates. 
This appendix describes how. this and other related^rl^ults were 
obtained and discusses their .interpretation and limlt^^ns^ 

BASIC APPROACH ' ^ " ? 

• — - ^i^^ 

By definition, annual earnings can be decompos.ed aj: ^follows: 

, ; V 

• ' Y = L • CE/L) • (H/E) • W ^"^"^ ^^'^ 

.where : ' x * - 

- . • . ^^f^ ^ - 

Y = annual earnings; ■ . ^<.%^t> ^ - 

L = the number of weeks* that an individ^jial was -^^ilable 
for employment during ,the,,year^ ^ 

(E/L) = the number of wetek^^^iaj: an IndivlduaV^^f £^pIoyed 
during the year as "^a proportion gf 'th.€?^^^mbeir of 
' . weeks that he or she was available! ;f or employment; 



^3 ' <r 



(H/E) = the average number of hours workedA^er week 
employed; and 

W - the average hourly wage rate. ^ ... 

The proportional change in earnings, AY/Y , equals the -^m of 
the proportional change in each of its four components plqs ^he 
sum of all interactions among ifhe proportional- changes in thes^ 
components. In general' the interactions are 3mall so that: 

. (AY/Y),^ (AL/L) + [A(E/L)/(E/L)] + [A(H/E)/(H/E)t t AW/W (F2) 



T 



Therefore the proportion of the change in earnings due to a 
change in one— of its -components approximately equals the 
proportional change in that component as a proportion of the sum 
of the proportional changes in all components.. For example, the 
proportion of the change in earnings due to .a change in labor 
force participation approximately equai^s 

(AL/L)/[(AL/L)+[A(E/L)/(E/L)] +[A(H/E)/(H/E)] +(AW/W)]. 

This procedure implicitly allocates each component's contribution 
to the interaction terms in proportion to its contribution to the 
sum of the terps in Equation F2. 

DATA AND ANALYSIS 

Earnings component data were not available for the full 
multiyear period upon which estimates of post-program earnings 
gains were based. Complete flata for participants were available 
from the Continuous Longitudinal Manpower Survey only for the year 
before and the first year after training,^ whereas corresponding 
data for comparison group members were available from the Current 
Population Survey *f or only one year (1975). 

Thus it was necessary to infer the composition of post- 
program earnings gains from the observed composition of the gross 
change in participants* earnings from the year before to the first 
year after training (see Table F-1). Applying the computational 
procedure described above to this information produced estimates 
of the composition of post-program earnings gains (see Table F-2). 

INTERPRETATIONS OF THE FINDINGS 

Although subject to limitations, the results in Table F-2 
support several broad generalizations about the effe.ct of CETA 
training for women. 

First, even conservative estimates indicate that the effect 
of training was substantial. For example, three-fifths 

of the average post-program earnings gain observed for female 



1. Data for the second year afi:er training were available for 
only part of the sample. 
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TABLE F-1. 



THE COMPONENTS OF .EARNINGS * FOR FEMALE 
PARTICIPANTS BEFORE AUD AFTER TRAINING 



CETA 







Average . 


/ 








Weeks 


Ave/rage 






Average 


Employed as 


Average 




Weeks 


^ Proportion 


Hours 


Hourly 




in the 


of Weeks , 


Wprked 


Wage Rate 




Labor 


in the 


pejr Week 


(in 1980 




Force 


Labor Force . 


Employed 


Dollars) 



All Female 
Participants 

Year before 

training 35 
Year after 

training 41 

Female Classroom 
Training Participants 

Year before 

training 34 

Year after 

training AO 

Female On-The Job 
Training Participants 

Year before 

training 35 

Year after 

training _ 45 

Female Work ' 
Experience Participants 

Year before. 

training 36 

Year after 

training 41 



0.47 • 
0.62 * 



0.45 
0.57 



0.51 



0.73 



0.50 
0.64 



33 
38 



34 
38 



36 
39 



31' 

36 



3.81 
4.49 



3.77 
4.65 



3.99 
4.46 



3.76 
4.19 
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TABLE F-2. PERCENTAGE OF THE AVERAGE EARNINGS GAIN EXPERIENCED^ BY 
ADULT FEMALE PARTICIPANTS DUE TO EACH OF THE FOUR 
BASIC COMPONENTS OF EARNINGS 



Percentage Due to Average 







Annoal Change In: 










Weeks Employed 










Weeks 


as a Percent- 


Hours 


Real 






in the 


age of Weeks 


Worked 


Hourly 






Labor 


In the Labor 


DGT We sk. 


Wage 




For Women In; 


Force 


Force 


Employed 




X LP L>a J. 


All CETA Training 


21 


39 


18 


22 


100 


Classroom 












training 


22 


34^ 


15 


29 


100 


On-the-job 












training 


31 


47 


9 


13 


100. 


Work experience 


20 


41 


23 


'16 


100 



SOURCE: Es^-ilnates based on the information ia Table F-1. 



participants remained- after eliminating the portions due to 
increased labor force participation and increased hours worked per 
week employed. This left roughly $800 due solely to increased 
abilities to find and .hold a job and to increased wage rates. 

A second major generalization supported by the results in 
Table F-2 is that the effects of the three different types of 
training were roughly the aame in terms of their magnitude and to 
a large e^tept also in terms of their composition. Chapter III 
indicated that average post-program earnings gains vere $1,400, 
$1,100, and $1,300 for women in classroom training, on-the-job 
training, and work experience, respectively. Table F-2 indicates 
that 63, 60, and 57 percent Jof these gains respectively were due 
to the effect of increased wage rates -and increased abilities to 
find and hold a job. ^ 



4 
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Lastly, a third important /generalization suj^orted by the 
data is thai: most (71 piercent for classroom training, 87 percent 
for on-the-job training, and- 84 percent for work experience) of 
the av^erage earnings gaia experienced by female CETA participants 
was due to an increase in the amount of time thfty worked* ^ 



Ll tdTATIONS OF THE FINDINGS 

■ f / 

Several potential^ problems limit more precise interpretation 
of the preceding results. First is the fact that gross earnings 
chag^ges (upon which th§ earnings component analysis was^ based) do 
not overlap perfectly with post-program earnings gains ( to which 
the results of this analysis •were inferred). Nevertheless the 
average post-program deviation from trend in the first year after 
training (Se.gment C in Figure F-1), which largely determined the 
average post-program arnings gain for that year,^ comprised about 
three-^f ifths of the average gross earnings change for female 
participants (Segments A plus B plus C) . Thus there was a sub- 
stantial fOverlap between the two measures of change in earnings. 

A second potentiay problQfn stems from tlie fact that data for 
the components ,of . earnings were obtained from retrospective sur- 
veys. Participants were asked on a quarter-by-quarter basis about 
the extent to which they sc/ught employment, the percentage of time 
they were employed, their wage rates, and their total earnings. 
Undoubtedly, this produced numerous reporting errors. But indi- 
vidual reporting errors largely cancelled each other in the 
determination of the group averages upon which the present 
analysis was Kased. For example. Appendix C indicated that 
average ^arnings^ obtained from survey data ^nerally were within 5 
percent of* corresponding average earnings ' ^obtained from Social* 
Secrfity records.* Thus it is uncleafr to what extent, if at all, 
survey errors wer« a prolJlem for this analysis. 



Post-programs earnings gains actually represent the average 
of segments C, D, arid E in Figure F-1 mi-nus their comparison 
group coiirfterparts '(which /are not shown but Here quite small) 
with a slight adjustment tor the pre-program dip. 
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Figure F-1. 

Post-Program Earnings Gains versus Gross Earnings Changes 



Years After Training x 

X 



E 



Year Before 
Training. 



Year 



KEY: 

A = RKOvery from pre-program dip 
8 » Earnings increase according to long-term trend 
C = Deviation from trend in the firstyear after training 
D = Deviation from trend in the second year after training 
E ' Deviation from trend in the third ftv after training 



J' 
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APPENDIX G. EXAMINING THE RELATIONSHIP BETWEEN POST-PROGRAM EARN- 
INGS GAINS AND THE LENGTH OF TRAINING 



Longer training was associated with larger post-program earn- 
ings gains for female CETA participants at a rate of $3.70 per 
day, on average. On the other -hand, ^there was generally no 
significant effect for male participants, regardless of the length 
of, training. 



ANALYSIS 



Appendix A developed the following model for estimating the 
average effect of training: 



where: 



DEV f* ^ the post-program year deviation from trend adjusted for 
^ serial correlation, in 1980 dollars; 

Tj^ = one for participants and zero for comparison g^oup 
members; \ 

« one when year t=m 'and zero otherwise; 

e the average deviation from trend in year m due to.chang- 
^ ing economic conditions, in 1980 dollars; 

" Xjj = the jth personal characteristic for person, 1; 

7*= the averag"e effect of, training, in 1980 dollars; and 

Ujt*- a random disturbance, in 1980^ dollars . 

Adding aji Interaction between 'the training variable Tj^ and the 
length of" training Lj (in days) produced a variable whose co- 
efficient measured -the additional gain in average annua'l post-" 
program earnings per additional day of training. Replacing Tj^ 
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with a set^ of dummy variables Tqjt — one for each of the three 
major types of training— and interacting each of these new 
variables with ' Lj , produced a set of ^ interaction terms whose 
coefficients measured the additional gain^ in average post-program 
earnings per additional day of each type of training. 

Estimates of these coefficients indicated that an additional 
^ day of training was associated with a S3. 70 increase in the 
. average annual post-program earnings of female participants (see 
\ Table G-1). Similar results were obtained for each of the three 
major types of training. On the other hailed, none of the three 
types of training appeared to increase the future earnings of male 
participants, regardless of the length of the training. 

To test for increasing or decreasing returns to additional 
days of training, quadratic interaction terms were added to the 
model, but the coefficients for these terms were not statistically 
significant , suggesting roughly constant returns to additional ' 
days of training within the range' of program lengths examine4 
(about 10 to 250 days). 



\ 

\ 
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tABLE THE MARGINAL CHANGE IN ANNUAL POST--PROGRAM EARNINGS 

ASSOCIATED WITH AN ADDITIONAL DAY OF TRAINING BY SEX 
AND TYPE OF TRAINING (In 1980 dollars)^. 







Women 


Men 


All CETA Participants 




3:70C - ^ 




In classroom training 




3.60C * 


2.80 


In on-the-job training 




6.50C 


-7.80C 
-1.90 


In work experience 




2.90^ 


SOURCE: Estimates were derived from the Continuous Longitudinal 
Manpower Survey and the March 1976 Current Population 
Survey supplemented by individual Social Security earnings 
records • 


a* For persons over, 24 


and in 


CETA training 


for- more than seven 



days* ^ 

b* Significant at the 0.05 level, 
c. Significant of the 0.01 level. 



4rf 
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APPENDIX H. COMBINING RESULTS FOR DIFFERENT GROUPS OF PARTICI- 
PANTS, DIFFERENT POST-PROGRAM YEARS, AND DIFFERENT 
TYPES OF TRAINING 



To summarize estimates of the effect of CETA training on 
participants' future earnings, it was necessary to combine these 
estimates for as many different groups as possible. Empirical 
tests indicated that there were no statistically significant 
differences: (I) between participants who entered the program 
'early in the, analysis period (from January through August 1975) 
and participants who entered later (from September 1975 'through 
June 1976); (jZ) among the results for each of the first three 
post-prQ^ram years; (3) among the results for each of the three 
major types of training; and (4) between the results for minorit^^ 
and nonminority participants. Thus it was appropriate to combine 
these results. On the other hand, differences between the 
findings for male and female participants were both statistically 
significant and large. Thus results for these groups were not 
combined • 



TESTING PROCEDURE 

Appendix A developed the following model for estimating the 
average effect, of CETA training: 



DEVjt* = 7* • Tit + ?5j* • Xji + 2 e^* vYR^ + Uit^ 

where: 



(HI) 



DEVj^* - the post-program year deviation from trend, ad justed for 
the pre-program dip, in 1980 dollars; 

Tjt " one for participants and zero for comparison group 

' , ^ members; 

YR* =» one when year t = m and zero otherwise; 

m ^ ' 
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the average devlg^'tion from trend in year ra "due Xo, chang- 
ing economic conditions, in 1980 dollars; 

the average effect of training, in 1980 dollar^;' 

Th^ jt^ personal characteristic for person i;'and 

Uj* = -a random disturbance, in 1980 dollars. 



To test for significant- differences in estimates of 7* (the 
effect of training) across 'each of the groups mentioned above, the 
program variable was interacted with variables representing each 
group, including all possible higher-order interactions. The full 
resulting model was then estimate^* It was then reestimated 
sequentially after first eliminating distinctions between entry 
groups; after next eliminating distinctions by post-program year; 
after next &liminating distinctions by type of training; after, 
next eliminating distinctions by minority status of the 
particif)ant; and lastly after eliminating distinctions by sex of 
the participant. To minimize the substantial computational costs 
involved, only data for participants were used. 

At each stage an F statistic was computed to determine 
whether or not eliminating a specific distinction decreased the 
explanatory power of the model by a statistically significant 
amount. No distinctions other than sex were statistically 
significant at the 0.05 level (see Table H-1). Thus combining 
results across all dimensions except sex appeared to be 
justifiable. 
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TABi-E'a-l . -F' "tests FOR 'POOLING RESULTS BY CETTA ENTRY GROl/P, POST^ 
-PROGRAM YEAR, TYPE OF TRAINING,, MINORITY STATUS, AND 

— — ~~ — ■ ' — V— 

' ' , ■ ■ Significant 

Pooling • • ■ ' ■. F • . at the - ' " .■ 

Sequentially . . Statistic^ 0-05 Level'' 



First by Entry Group, • 


0.8 




' ^. No * . 


Then by Post-Prggram Year 


0.5 




No 


Then* by Type of Training 


0.8 


< 4 

4 


No ' ' 


Then by Minority Status 


1.5 ' 




No * ' 


Then by Sex 


- 14'. 3C 


f 


Yes^ / 



SOURCE: Estimates w^re derivjed from the Continuous ■ Longitudinal 
Manpower Survey . and* the March 1976 Current Population 
Survey, supplemented .by individual , Social Security 
' earnings recprds. ' . * / • \ , > >^ 

a\ For persons over 24 years old who were in CETA- training more 

than seven days. - ' * " 

'* 

b. ' Each V test was conditional upon the velidination of prior 

distinctions in the sequence aend the sequence was based on 
' expectations about the likely importance of each dl$tinction. 

c. Significant at. the 0.01 level. ^ - » 



^ 
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